Inference for High-Dimensional Model Averaging Estimators

Lise Léonard, Eugen Pircalabelu and Rainer von Sachs
Additional contact information
Lise Léonard: Université catholique de Louvain, LIDAM/ISBA, Belgium
Eugen Pircalabelu: Université catholique de Louvain, LIDAM/ISBA, Belgium
Rainer von Sachs: Université catholique de Louvain, LIDAM/ISBA, Belgium

No 2025019, LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA)

Abstract: Selection methods for high-dimensional models are well developed, but they do not take into account the choice of the model, which leads to an underestimation of the variability of the estimator. We propose a procedure for model averaging in high-dimensional regression models that allows inference even when the number of predictors is larger than the sample size. The proposed estimator is constructed from the debiased Lasso and the weights are chosen to reduce the prediction risk. We derive the asymptotic distribution of the estimator within a high-dimensional framework and offer guarantees for the minimal loss prediction obtained using our choice of the weights. In contrast to existing approaches, our proposedmethod combines the advantages of model averaging with the possibility of inference based on asymptotic normality. The estimator shows a smaller prediction risk than its competitors when applied to a real, high-dimensional dataset and along various simulation studies, confirming our theoretical results.

Keywords: Debiased Lasso; High-Dimensional Inference; Model Averaging; Prediction Risk (search for similar items in EconPapers)
Pages: 33
Date: 2025-12-02
Note: In: Statistica Sinica, 2026
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aiz:louvar:2025019

Access Statistics for this paper

More papers in LIDAM Reprints ISBA from Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA) Voie du Roman Pays 20, 1348 Louvain-la-Neuve (Belgium). Contact information at EDIRC.
Bibliographic data for series maintained by Nadja Peiffer ().