Hierarchical Models and Tuning of Random Walk Metropolis Algorithms

Mylène Bédard

Journal of Probability and Statistics, 2019, vol. 2019, 1-24

Abstract:

We obtain weak convergence and optimal scaling results for the random walk Metropolis algorithm with a Gaussian proposal distribution. The sampler is applied to hierarchical target distributions, which form the building block of many Bayesian analyses. The global asymptotically optimal proposal variance derived may be computed as a function of the specific target distribution considered. We also introduce the concept of locally optimal tunings, i.e., tunings that depend on the current position of the Markov chain. The theorems are proved by studying the generator of the first and second components of the algorithm and verifying their convergence to the generator of a modified RWM algorithm and a diffusion process, respectively. The rate at which the algorithm explores its state space is optimized by studying the speed measure of the limiting diffusion process. We illustrate the theory with two examples. Applications of these results on simulated and real data are also presented.

Date: 2019
References: Add references at CitEc
Citations:

Downloads: (external link)
http://downloads.hindawi.com/journals/JPS/2019/8740426.pdf (application/pdf)
http://downloads.hindawi.com/journals/JPS/2019/8740426.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnljps:8740426

DOI: 10.1155/2019/8740426

Access Statistics for this article

More articles in Journal of Probability and Statistics from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().