A Monte Carlo Estimation of the Entropy for Markov Chains

Didier Chauveau () and Pierre Vandekerkhove
Additional contact information
Didier Chauveau: Université d’Orléans
Pierre Vandekerkhove: Université de Marne-la-Vallée

Methodology and Computing in Applied Probability, 2007, vol. 9, issue 1, 133-149

Abstract: Abstract We introduce an estimate of the entropy $\mathbb{E}_{p^t}(\log p^t)$ of the marginal density p t of a (eventually inhomogeneous) Markov chain at time t≥1. This estimate is based on a double Monte Carlo integration over simulated i.i.d. copies of the Markov chain, whose transition density kernel is supposed to be known. The technique is extended to compute the external entropy $\mathbb{E}_{p_1^t}(\log p^t)$ , where the p 1 t s are the successive marginal densities of another Markov process at time t. We prove, under mild conditions, weak consistency and asymptotic normality of both estimators. The strong consistency is also obtained under stronger assumptions. These estimators can be used to study by simulation the convergence of p t to its stationary distribution. Potential applications for this work are presented: (1) a diagnostic by simulation of the stability property of a Markovian dynamical system with respect to various initial conditions; (2) a study of the rate in the Central Limit Theorem for i.i.d. random variables. Simulated examples are provided as illustration.

Keywords: Entropy; Kullback information; Markov chains; Stability; Rate in the Central Limit Theorem; 62B10; 60F05; 60J10 (search for similar items in EconPapers)
Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11009-006-9010-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metcap:v:9:y:2007:i:1:d:10.1007_s11009-006-9010-6

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/11009

DOI: 10.1007/s11009-006-9010-6

Access Statistics for this article

Methodology and Computing in Applied Probability is currently edited by Joseph Glaz

More articles in Methodology and Computing in Applied Probability from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().