A Review on Variable Selection in Regression Analysis

Loann Desboulets

Econometrics, 2018, vol. 6, issue 4, 1-27

Abstract: In this paper, we investigate several variable selection procedures to give an overview of the existing literature for practitioners. “Let the data speak for themselves” has become the motto of many applied researchers since the number of data has significantly grown. Automatic model selection has been promoted to search for data-driven theories for quite a long time now. However, while great extensions have been made on the theoretical side, basic procedures are still used in most empirical work, e.g., stepwise regression. Here, we provide a review of main methods and state-of-the art extensions as well as a topology of them over a wide range of model structures (linear, grouped, additive, partially linear and non-parametric) and available software resources for implemented methods so that practitioners can easily access them. We provide explanations for which methods to use for different model purposes and their key differences. We also review two methods for improving variable selection in the general sense.

Keywords: variable selection; automatic modelling; sparse models (search for similar items in EconPapers)
JEL-codes: B23 C C00 C01 C1 C2 C3 C4 C5 C8 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
https://www.mdpi.com/2225-1146/6/4/45/pdf (application/pdf)
https://www.mdpi.com/2225-1146/6/4/45/ (text/html)

Related works:
Working Paper: A Review on Variable Selection in Regression Analysis (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jecnmx:v:6:y:2018:i:4:p:45-:d:185046

Access Statistics for this article

Econometrics is currently edited by Ms. Jasmine Liu

More articles in Econometrics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().