Weighted particle tempering

Marcos Carzolio and Scotland Leman

Computational Statistics & Data Analysis, 2017, vol. 114, issue C, 26-37

Abstract: The application of Bayesian methods often requires Metropolis–Hastings or related algorithms to sample from an intractable posterior distribution. In especially challenging cases, such as with strongly correlated parameters or multimodal posteriors, exotic forms of Metropolis–Hastings are preferred for generating samples within a reasonable time. These algorithms require nontrivial and often prohibitive tuning, with little or no performance guarantees. In light of this difficulty, a new, parallelizable algorithm called weighted particle tempering is introduced. Weighted particle tempering is easily tuned and suitable for a broad range of applications. The algorithm works by running multiple random walk Metropolis chains directed at a tempered version of the target distribution, weighting the iterates and resampling. The algorithm’s performance monotonically improves with more of these underlying chains, a feature that simplifies tuning. Through the use of simulation studies, weighted particle tempering is shown to outperform two similar methods: parallel tempering and parallel hierarchical sampling. In addition, two case studies are explored: breast cancer classification and graphical models for financial data.

Keywords: Bayesian classification tree; Gaussian graphical model; Markov chain Monte Carlo; Multi-modality; Parallel algorithm (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947317300786
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:114:y:2017:i:c:p:26-37

DOI: 10.1016/j.csda.2017.04.005

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().