A Review on Variable Selection in Regression Analysis

Loann D. Desboulets
Additional contact information
Loann D. Desboulets: Aix-Marseille Univ., CNRS, EHESS, Centrale Marseille, AMSE

No 1852, AMSE Working Papers from Aix-Marseille School of Economics, France

Abstract: In this paper, we investigate on 39 Variable Selection procedures to give an overview of the existing literature for practitioners. "Let the data speak for themselves" has become the motto of many applied researchers since the amount of data has significantly grew. Automatic model selection have been raised by the search for data-driven theories for quite a long time now. However while great extensions have been made on the theoretical side still basic procedures are used in most empirical work, eg. Stepwise Regression. Some reviews are already available in the literature for variable selection, but always focus on a specific topic like linear regression, groups of variables or smoothly varying coefficients. Here we provide a review of main methods and state-of-the art extensions as well as a topology of them over a wide range of model structures (linear, grouped, additive, partially linear and non-parametric). We provide explanations for which methods to use for different model purposes and what are key differences among them. We also review two methods for improving variable selection in the general sense.

Keywords: variable selection; automatic modelling; sparse models (search for similar items in EconPapers)
JEL-codes: C50 C59 (search for similar items in EconPapers)
Pages: 23 pages
Date: 2018-05
New Economics Papers: this item is included in nep-ecm
References: Add references at CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://www.amse-aixmarseille.fr/sites/default/fil ... /wp_2018_-_nr_52.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aim:wpaimx:1852

Access Statistics for this paper

More papers in AMSE Working Papers from Aix-Marseille School of Economics, France AMU-AMSE - 5-9 Boulevard Maurice Bourdet, CS 50498 - 13205 Marseille Cedex 1. Contact information at EDIRC.
Bibliographic data for series maintained by Gregory Cornu ().