Communication-efficient model averaging prediction for massive data with asymptotic optimality

Xiaochao Xia (), Sijin He and Naiwen Pang
Additional contact information
Xiaochao Xia: Chongqing University
Sijin He: Chongqing University
Naiwen Pang: Chongqing University

Statistical Papers, 2025, vol. 66, issue 2, No 11, 45 pages

Abstract: Abstract This paper focuses on model averaging prediction for massive dataset. Specifically, in the framework of Mallows model averaging, we propose two distributed approaches to estimate the parameters of each submodel and weights in the final weighted estimator, respectively. The first approach is an one-shot procedure that aggregates the estimated parameters and weights from each local machine via simple average. The second approach is an iterative procedure that approximates the global loss by a surrogate loss in parameter estimation. The two proposed distributed estimators are communication-efficient, where the former requires only one round of communication and the latter requires two rounds of communications between central and local machines for parameter estimation to achieve the globally statistical efficiency. To estimate weight vector, two distributed algorithms are presented. Furthermore, we theoretically justify the two approaches by proving convergence rates and asymptotic normalities. More importantly, we establish the asymptotic optimality of distributed estimator of weight vector in terms of the out-of-sample prediction error criterion. Finally, simulations and a real data analysis are carried out to illustrate the proposed methods.

Keywords: Massive data; Communication-efficient estimators; Mallows model averaging; Asymptotic optimality (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-025-01664-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:66:y:2025:i:2:d:10.1007_s00362-025-01664-3

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-025-01664-3

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().