Rates of convergence of the adaptive elastic net and the post-selection procedure in ultra-high dimensional sparse models

Yuehan Yang and Hu Yang

Communications in Statistics - Theory and Methods, 2021, vol. 50, issue 1, 73-94

Abstract: This article studies the convergence rates of the adaptive elastic net and proposes a post-selection method. In the low dimensional settings, Zou and Zhou proved the variable selection consistency of the adaptive elastic net. In this article, we show the probability of the adaptive elastic net selecting the wrong variables decays at an exponential rate in the ultra-high dimensional setting. The Irrepresentable condition isn’t necessary according to some appropriate initial estimator. Furthermore, we show that the MSE and bias of the adaptive elastic net may lead to an inferior rate depending on the choice of the tuning parameters. We also prove that there exists a bias of asymptotic normality in the adaptive elastic net. Hence we propose a post-selection procedure, called SSLS (Separate Selection from Least Squares), to improve the bias problem of the adaptive elastic net. It is shown that the SSLS’s bias decays at an exponential rate and it is MSE decays to zero. The variable selection consistency of SSLS implies its asymptotic normality. We show by simulations and financial modeling that the SSLS performs better than the other oracle-like methods.

Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2019.1628991 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:50:y:2021:i:1:p:73-94

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2019.1628991

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().