Unconstrained Metropolis–Hastings Sampling of Covariance Matrices

Daniel Turek

Journal of Probability and Statistics, 2025, vol. 2025, 1-9

Abstract: Markov chain Monte Carlo (MCMC), the predominant algorithm for fitting hierarchal models to data in a Bayesian setting, relies on the ability to sample from the full conditional distributions of unobserved parameters. Covariance or precision matrices offer a unique sampling challenge due to the constraints on the elements of symmetric positive-definite matrices. Historically, MCMC algorithms have relied upon conjugate prior-likelihood forms for such matrices to sample directly from the conditional distribution. In the absence of conjugacy, Metropolis–Hastings sampling is problematic due to the challenge of generating suitable proposal values. Here, we develop a general Metropolis–Hastings sampling algorithm for covariance matrices, which makes proposals on an unconstrained domain through use of a bijective transformation. Our main contribution is a derivation of the Metropolis–Hastings acceptance probability for proposals made using this transformation. Pseudocode is provided for implementing our algorithm, and we also present a simulation study analyzing asymptotic performance under varying matrix dimensions and correlation structures. We present a real data example using this methodology to fit a hierarchical model for species abundance and detection using correlated random effects, for several bird species in the White Mountain National Forest, New Hampshire. Our method provides a simple and general-purpose approach for MCMC sampling of nonconjugate covariance matrices in arbitrary hierarchical model structures.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://downloads.hindawi.com/journals/jps/2025/4744162.pdf (application/pdf)
http://downloads.hindawi.com/journals/jps/2025/4744162.xml (application/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnljps:4744162

DOI: 10.1155/jpas/4744162

Access Statistics for this article

More articles in Journal of Probability and Statistics from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().