Statistical inference for the [epsilon]-entropy and the quadratic Rényi entropy

Nikolaj Leonenko and Oleg Seleznjev

Journal of Multivariate Analysis, 2010, vol. 101, issue 9, 1981-1994

Abstract: Entropy and its various generalizations are widely used in mathematical statistics, communication theory, physical and computer sciences for characterizing the amount of information in a probability distribution. We consider estimators of the quadratic Rényi entropy and some related characteristics of discrete and continuous probability distributions based on the number of coincident (or [epsilon]-close) vector observations in the corresponding independent and identically distributed sample. We show some asymptotic properties of these estimators (e.g., consistency and asymptotic normality). These estimators can be used in various problems in mathematical statistics and computer science (e.g., distribution identification problems, average case analysis for random databases, approximate pattern matching in bioinformatics, cryptography).

Keywords: Entropy; estimation; Quadratic; Renyi; entropy; U-statistics (search for similar items in EconPapers)
Date: 2010
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0047-259X(10)00118-1
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:101:y:2010:i:9:p:1981-1994

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().