In defense of LASSO

Chi Tim Ng, Woojoo Lee and Youngjo Lee

Communications in Statistics - Theory and Methods, 2022, vol. 51, issue 9, 3018-3042

Abstract: Although LASSO has been criticized for selecting too many covariates, it is illustrated in this paper that the bigger model chosen by LASSO method is suitable for exploratory research aiming at identifying all potential causes for further scientific investigation. Up to now, all criticisms assume that the covariates are observed without measurement errors, which is not likely to be true in many practical situations. Under measurement errors, the meaning of “relevant covariates” can be ambiguous. In such a situation, some covariates without an association with the response can be “potentially relevant”. The crucial point is that “relevant” and “potentially relevant” covariates cannot be distinguished based on the observed data in the presence of measurement errors. To avoid misinterpretation, both should be included in the model. This means that a bigger model is preferred. To understand the subset of covariates that should be included, a factor model of the covariates is introduced. Furthermore, new consistency theory is established under conditions weaker than those in Meinshausen and Bühlmann to cope with the situations where the preferred subset is not the same as the true model.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2020.1788080 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:51:y:2022:i:9:p:3018-3042

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2020.1788080

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().