An Improved Mixture Model of Gaussian Processes and Its Classification Expectation–Maximization Algorithm

Yurong Xie, Di Wu () and Zhe Qiang
Additional contact information
Yurong Xie: School of Mathematics and Statistics, Shaanxi Normal University, Xi’an 710119, China
Di Wu: School of Computer Science, Shaanxi Normal University, Xi’an 710119, China
Zhe Qiang: School of Mathematics, Northwest University, Xi’an 710127, China

Mathematics, 2023, vol. 11, issue 10, 1-19

Abstract: The mixture of experts (ME) model is effective for multimodal data in statistics and machine learning. To treat non-stationary probabilistic regression, the mixture of Gaussian processes (MGP) model has been proposed, but it may not perform well in some cases due to the limited ability of each Gaussian process (GP) expert. Although the mixture of Gaussian processes (MGP) and warped Gaussian process (WGP) models are dominant and effective for non-stationary probabilistic regression, they may not be able to handle general non-stationary probabilistic regression in practice. In this paper, we first propose the mixture of warped Gaussian processes (MWGP) model as well as its classification expectation–maximization (CEM) algorithm to address this problem. To overcome the local optimum of the CEM algorithm, we then propose the split and merge CEM (SMC EM) algorithm for MWGP. Experiments were done on synthetic and real-world datasets, which show that our proposed MWGP is more effective than the models used for comparison, and the SMCEM algorithm can solve the local optimum for MWGP.

Keywords: mixture of experts; warped Gaussian process; classification expectation–maximization algorithm; local optimum; non-stationary probabilistic regression (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/10/2251/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/10/2251/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:10:p:2251-:d:1144540

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().