From screening to variable selection by an iterative nonparametric procedure based on derivatives

Francesco Giordano (), Sara Milito () and Maria Lucia Parrella ()
Additional contact information
Francesco Giordano: University of Salerno
Sara Milito: University of Salerno
Maria Lucia Parrella: University of Salerno

Statistical Papers, 2025, vol. 66, issue 4, No 19, 35 pages

Abstract: Abstract To identify the true relevant predictors in a nonparametric regression model with ultra-high-dimensional data, we propose a general iterative procedure that is able to transform a screening procedure into a variable selection one, without requiring the number of true relevant variables to be finite. This fully nonparametric procedure is based on a novel combination of DELSIS (a model-free variable screening method based on empirical likelihood and derivative estimation) and PenGAM (a penalised variable selection method based on splines). The main advantage of the new proposal is its robustness to the presence of correlation among the predictors and its capability to correctly identify the whole set of relevant covariates, including those marginally uncorrelated but jointly related to the response (“hidden covariates”) and those with low signal (“weak covariates”), much better than the main alternative approaches. From a theoretical point of view, we show the consistency of the proposal and its faster estimation rate with respect to the classical penalised approaches. Finally, we illustrate the performance of the new procedure through some simulations and an empirical analysis.

Keywords: High dimension; Variable selection; Nonparametric regression models; Variable screening; Iterative procedure (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-025-01700-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:66:y:2025:i:4:d:10.1007_s00362-025-01700-2

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-025-01700-2

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().