Asymptotically faster estimation of high‐dimensional additive models using subspace learning

Kejun He, Shiyuan He and Jianhua Z. Huang

Scandinavian Journal of Statistics, 2024, vol. 51, issue 4, 1587-1618

Abstract: As a commonly used nonparametric model to overcome the curse of dimensionality, the additive model continually attracts attentions of researchers. Our recent work (He et al., 2022) proposed to reduce the number of unknown functions to be estimated through learning an adaptive subspace shared by the additive component functions. Equipped with an efficient algorithm, our proposed reduced additive model outperforms the state‐of‐the‐art alternatives in numerical studies. However, the asymptotic properties of the proposed estimators have not been explored and the empirical findings are short of theoretical explanation. In this work, we fill in the theoretical gap by showing the resulting estimator has faster convergence rate than the estimation without subspace learning; and this is true even when the reduced additive model is only an approximation, provided that the subspace approximation error is small. Moreover, the proposed method is able to consistently identify the relevant predictors. The developed theoretical results back up the earlier empirical findings.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/sjos.12756

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:scjsta:v:51:y:2024:i:4:p:1587-1618

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0303-6898

Access Statistics for this article

Scandinavian Journal of Statistics is currently edited by ÿrnulf Borgan and Bo Lindqvist

More articles in Scandinavian Journal of Statistics from Danish Society for Theoretical Statistics, Finnish Statistical Society, Norwegian Statistical Association, Swedish Statistical Association
Bibliographic data for series maintained by Wiley Content Delivery ().