Approximate Laplace approximations for scalable model selection

David Rossell, Oriol Abril and Anirban Bhattacharya

Journal of the Royal Statistical Society Series B, 2021, vol. 83, issue 4, 853-879

Abstract: We propose the approximate Laplace approximation (ALA) to evaluate integrated likelihoods, a bottleneck in Bayesian model selection. The Laplace approximation (LA) is a popular tool that speeds up such computation and equips strong model selection properties. However, when the sample size is large or one considers many models the cost of the required optimizations becomes impractical. ALA reduces the cost to that of solving a least‐squares problem for each model. Further, it enables efficient computation across models such as sharing pre‐computed sufficient statistics and certain operations in matrix decompositions. We prove that in generalized (possibly non‐linear) models ALA achieves a strong form of model selection consistency for a suitably‐defined optimal model, at the same functional rates as exact computation. We consider fixed‐ and high‐dimensional problems, group and hierarchical constraints, and the possibility that all models are misspecified. We also obtain ALA rates for Gaussian regression under non‐local priors, an important example where the LA can be costly and does not consistently estimate the integrated likelihood. Our examples include non‐linear regression, logistic, Poisson and survival models. We implement the methodology in the R package mombf.

Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://doi.org/10.1111/rssb.12466

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:83:y:2021:i:4:p:853-879

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().