Bayes Estimate and Inference for Entropy and Information Index of Fit

Thomas Mazzuchi, Ehsan Soofi and Refik Soyer

Econometric Reviews, 2008, vol. 27, issue 4-6, 428-456

Abstract: This article defines a quantized entropy and develops Bayes estimates and inference for the entropy and a Kullback-Leibler information index of the model fit. We use a Dirichlet process prior for the unknown data-generating distribution with a maximum entropy candidate model as the expected distribution. This formulation produces prior and posterior distributions for the quantized entropy, the information index of fit, the moments, and the model parameters. The posterior mean of the quantized entropy provides a Bayes estimate of entropy under quadratic loss. The consistency of the Bayes estimates and the information index are shown. The implementation and the performances of the Bayes estimates are illustrated using data simulated from exponential, gamma, and lognormal distributions.

Keywords: Dirichlet process; Kullback-Leibler; Model selection; Nonparametric Bayes (search for similar items in EconPapers)
Date: 2008
References: View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.tandfonline.com/doi/abs/10.1080/07474930801960311 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:emetrv:v:27:y:2008:i:4-6:p:428-456

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/LECR20

DOI: 10.1080/07474930801960311

Access Statistics for this article

Econometric Reviews is currently edited by Dr. Essie Maasoumi

More articles in Econometric Reviews from Taylor & Francis Journals
Bibliographic data for series maintained by ().