On the use of compactly supported density estimates in problems of discrimination

Peter Hall

Journal of Multivariate Analysis, 1987, vol. 23, issue 1, 131-158

Abstract: It is often proposed (R. P. W. Duin, I.E.E.E. Trans. Comput.25 (1976), 1175-1179; J. D. F. Habbema, J. Hermans, and J. Remme, "Compstat 1978" (Corsten and Hermans, Eds.), pp. 178-185, "Compstat 1974" (G. Bruckman, Ed.), pp. 101-110;[16] and [17]) that Kullback-Leibler loss or likelihood cross-validation be used to select the window size when a kernel density estimate is constructed for purposes of discrimination. Some numerical work (E. F. Schuster and G. G. Gregory, "Fifteenth Annual Symposium on the Interface of Computer Science and Statistics" (W. F. Eddy, Ed.), pp. 295-298, Springer-Verlag, New York, 1981) argues against this proposal, but a major theoretical contribution (Y. S. Chow, S. Geman, and L. D. Wu, Ann. Statist.11 (1983), 25-38) demonstrates consistency in the important case of compactly supported kernels. In the present paper we argue that in the context of Kullback-Leibler loss and likelihood cross-validation, compactly supported kernels are an unwise choice. They can result in unnecessarily large loss, and can lead to infinite loss when likelihood cross-validation is used to select window size. Compactly supported kernels often dictate that window size be chosen by trading off one part of the variance component of loss against the other, with scant regard for bias; compare the classical theory, where minimum loss is achieved by trading off variance against bias.

Keywords: cross-validation; density; estimation; discrimination; information; kernel; Kullback-Leibler; loss; likelihood (search for similar items in EconPapers)
Date: 1987
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/0047-259X(87)90182-5
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:23:y:1987:i:1:p:131-158

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().