Communication-efficient distributed EM algorithm

Xirui Liu (), Mixia Wu () and Liwen Xu ()
Additional contact information
Xirui Liu: Beijing University of Technology
Mixia Wu: Beijing University of Technology
Liwen Xu: North China University of Technology

Statistical Papers, 2024, vol. 65, issue 9, No 7, 5575-5592

Abstract: Abstract The Expectation Maximization (EM) algorithm is widely used in latent variable model inference. However, when data are distributed across various locations, directly applying the EM algorithm can often be impractical due to communication expenses and privacy considerations. To address these challenges, a communication-efficient distributed EM algorithm is proposed. Under mild conditions, the proposed estimator achieves the same mean squared error bound as the centralized estimator. Furthermore, the proposed method requires only one extra round of communication compared to the Average estimator. Numerical simulations and a real data example demonstrate that the proposed estimator significantly outperforms the Average estimator in terms of mean squared errors.

Keywords: EM algorithm; Distributed inference; Communication-efficient; Latent variable models (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-024-01594-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:65:y:2024:i:9:d:10.1007_s00362-024-01594-6

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-024-01594-6

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().