A scalable approximate Bayesian inference for high-dimensional Gaussian processes

Anis Fradi, Chafik Samir and François Bachoc

Communications in Statistics - Theory and Methods, 2022, vol. 51, issue 17, 5937-5956

Abstract: In this paper, we adopt a Bayesian point of view, based on Gaussian processes, for classifying high-dimensional data. Since computing the exact marginal likelihood remains difficult, if not impossible, for discrete likelihoods and high-dimensional inputs, we introduce two different methods to improve the efficiency and the scalability of Gaussian processes for classification: scalable Laplace approximation and scalable expectation propagation, together with an embedding for dimension reduction. The proposed methods are shown to handle multimodal posteriors and improve the prediction quality, jointly. Various numerical tests on simulated and real data provide a comparison with alternative Bayesian and non Bayesian predictors. More particularly, the comparison study confirms that the ability of our proposed methods to estimate the marginal likelihood efficiently yields better predictions, especially for complex tasks.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2020.1850793 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:51:y:2022:i:17:p:5937-5956

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2020.1850793

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().