Markov chain Monte Carlo sampling using a reservoir method

Zhonglei Wang

Computational Statistics & Data Analysis, 2019, vol. 139, issue C, 64-74

Abstract: Markov chain Monte Carlo methods are widely used to draw a sample from a target distribution which is hard to characterize analytically, and reservoir sampling is developed to obtain a sample from a data stream sequentially in a single pass. A stochastic thinning algorithm using reservoir sampling is proposed, and it can be embedded in most Markov chain Monte Carlo methods to reduce the autocorrelation among the generated sample. The distribution of the sample generated by the proposed sampling algorithm converges in total variation to the target distribution in probability under mild conditions. A practical method is introduced to detect the convergence of the proposed sampling algorithm. Two simulation studies are conducted to compare the proposed sampling algorithm and the corresponding Markov chain Monte Carlo methods without thinning, and results show that the estimation bias of the proposed sampling algorithm is approximately the same as the corresponding Markov chain Monte Carlo method, but the proposed sampling algorithm has a smaller Monte Carlo variance. The proposed sampling algorithm saves computer memory in the sense that the storage of a small portion of the Markov chain is required in each iteration.

Keywords: Convergence; Metropolis–Hastings algorithm; Removal procedure; Stochastic thinning (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947319301124
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:139:y:2019:i:c:p:64-74

DOI: 10.1016/j.csda.2019.05.001

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().