SPEEDING UP MCMC BY DELAYED ACCEPTANCE AND DATA SUBSAMPLING

Matias Quiroz ()
Additional contact information
Matias Quiroz: Research Department, Central Bank of Sweden, Postal: Sveriges Riksbank, SE-103 37 Stockholm, Sweden

No 307, Working Paper Series from Sveriges Riksbank (Central Bank of Sweden)

Abstract: The complexity of Markov Chain Monte Carlo (MCMC) algorithms arises from the requirement of a likelihood evaluation for the full data set in each iteration. Payne and Mallick (2014) propose to speed up the Metropolis-Hastings algorithm by a delayed acceptance approach where the acceptance decision proceeds in two stages. In the rst stage, an estimate of the likelihood based on a random subsample determines if it is likely that the draw will be accepted and, if so, the second stage uses the full data likelihood to decide upon nal acceptance. Evaluating the full data likelihood is thus avoided for draws that are unlikely to be accepted. We propose a more precise likelihood estimator which incorporates auxiliary information about the full data likelihood while only operating on a sparse set of the data. It is proved that the resulting delayed acceptance MCMC is asymptotically more ecient compared to that of Payne and Mallick (2014). Furthermore, we adapt the method to handle data sets that are too large to t in Random-Access Memory (RAM). This adaptation results in an algorithm that samples from an approximate posterior with well studied theoretical properties in the literature.

Keywords: Bayesian inference; Markov chain Monte Carlo; Delayed acceptance MCMC; Large data; Survey sampling (search for similar items in EconPapers)
JEL-codes: C11 C13 C15 C55 C83 (search for similar items in EconPapers)
Pages: 30 pages
Date: 2015-08-01
New Economics Papers: this item is included in nep-ecm
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.riksbank.se/Documents/Rapporter/Working ... rap_wp307_150921.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hhs:rbnkwp:0307

Access Statistics for this paper

More papers in Working Paper Series from Sveriges Riksbank (Central Bank of Sweden) Sveriges Riksbank, SE-103 37 Stockholm, Sweden. Contact information at EDIRC.
Bibliographic data for series maintained by Lena Löfgren ().