Empirical and instance‐dependent estimation of Markov chain and mixing time
Geoffrey Wolfer
Scandinavian Journal of Statistics, 2024, vol. 51, issue 2, 557-589
Abstract:
We address the problem of estimating the mixing time of a Markov chain from a single trajectory of observations. Unlike most previous works which employed Hilbert space methods to estimate spectral gaps, we opt for an approach based on contraction with respect to total variation. Specifically, we estimate the contraction coefficient introduced in Wolfer (2020), inspired from Dobrushin's. This quantity, unlike the spectral gap, controls the mixing time up to strong universal constants and remains applicable to nonreversible chains. We improve existing fully data‐dependent confidence intervals around this contraction coefficient, which are both easier to compute and thinner than spectral counterparts. Furthermore, we introduce a novel analysis beyond the worst‐case scenario by leveraging additional information about the transition matrix. This allows us to derive instance‐dependent rates for estimating the matrix with respect to the induced uniform norm, and some of its mixing properties.
Date: 2024
References: View complete reference list from CitEc
Citations:
Downloads: (external link)
https://doi.org/10.1111/sjos.12686
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:bla:scjsta:v:51:y:2024:i:2:p:557-589
Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0303-6898
Access Statistics for this article
Scandinavian Journal of Statistics is currently edited by ÿrnulf Borgan and Bo Lindqvist
More articles in Scandinavian Journal of Statistics from Danish Society for Theoretical Statistics, Finnish Statistical Society, Norwegian Statistical Association, Swedish Statistical Association
Bibliographic data for series maintained by Wiley Content Delivery ().