Convergence rates and asymptotic standard errors for Markov chain Monte Carlo algorithms for Bayesian probit regression

Vivekananda Roy and James P. Hobert

Journal of the Royal Statistical Society Series B, 2007, vol. 69, issue 4, 607-623

Abstract: Summary. Consider a probit regression problem in which Y1, …, Yn are independent Bernoulli random variables such that where xi is a p‐dimensional vector of known covariates that are associated with Yi, β is a p‐dimensional vector of unknown regression coefficients and Φ(·) denotes the standard normal distribution function. We study Markov chain Monte Carlo algorithms for exploring the intractable posterior density that results when the probit regression likelihood is combined with a flat prior on β. We prove that Albert and Chib's data augmentation algorithm and Liu and Wu's PX‐DA algorithm both converge at a geometric rate, which ensures the existence of central limit theorems for ergodic averages under a second‐moment condition. Although these two algorithms are essentially equivalent in terms of computational complexity, results of Hobert and Marchev imply that the PX‐DA algorithm is theoretically more efficient in the sense that the asymptotic variance in the central limit theorem under the PX‐DA algorithm is no larger than that under Albert and Chib's algorithm. We also construct minorization conditions that allow us to exploit regenerative simulation techniques for the consistent estimation of asymptotic variances. As an illustration, we apply our results to van Dyk and Meng's lupus data. This example demonstrates that huge gains in efficiency are possible by using the PX‐DA algorithm instead of Albert and Chib's algorithm.

Date: 2007
References: View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
https://doi.org/10.1111/j.1467-9868.2007.00602.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:69:y:2007:i:4:p:607-623

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().