 Information Measures for Nonparametric Kernel EstimationNeshat Beheshti, Jeffrey Racine and Ehsan S. Soofi Department of Economics Working Papers from McMaster University Abstract: This paper addresses the following question: How much information do the kernel function and the bandwidth provide for nonparametric kernel estimation? The question is addressed by showing that kernel estimation of a cumulative distribution function (CDF) is an information transmission procedure for transforming the empirical cumulative distribution function into a smooth estimate. The transmission channel is the kernel function itself, which is a conditional distribution with a data point as its location parameter and a bandwidth as its scale parameter. The output of the information transmission procedure is the kernel estimate of the CDF which is a marginal distribution constructed as the sample average of the kernel functions centered at each data point. This framework provides a lower bound for the entropy of the kernel estimate of the distribution in terms of the entropy of the kernel function and the bandwidth, an input information measure for kernel smoothing, and a measure of information for kernel estimation. A family of maximum entropy kernels that includes several well-known kernel functions is identified. These kernels are compared according to the information measures developed herein. Keywords: information diagnostics; Kernel selection; entropy; mutual information. (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:mcm:deptwp:2015-03 Access Statistics for this paper More papers in Department of Economics Working Papers from McMaster University Contact information at EDIRC. |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.