Variable Selection and Shrinkage: Comparison of Some Approaches

K. Vach, W. Sauerbrei and M. Schumacher

Statistica Neerlandica, 2001, vol. 55, issue 1, 53-75

Abstract: A common strategy within the framework of regression models is the selection of variables with possible predictive value, which are incorporated in the regression model. Two recently proposed methods, Breiman's Garotte (Breiman, 1995) and Tibshirani's Lasso (Tibshirani, 1996) try to combine variable selection and shrinkage. We compare these with pure variable selection and shrinkage procedures. We consider the backward elimination procedure as a typical variable selection procedure and as an example of a shrinkage procedure an approach of Van Houwelingen and Le Cessie (1990). Additionally an extension of van Houwelingens and le Cessies approach proposed by Sauerbrei (1999) is considered. The ordinary least squares method is used as a reference. With the help of a simulation study we compare these approaches with respect to the distribution of the complexity of the selected model, the distribution of the shrinkage factors, selection bias, the bias and variance of the effect estimates and the average prediction error.

Date: 2001
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/1467-9574.00156

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:stanee:v:55:y:2001:i:1:p:53-75

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0039-0402

Access Statistics for this article

Statistica Neerlandica is currently edited by Miroslav Ristic, Marijtje van Duijn and Nan van Geloven

More articles in Statistica Neerlandica from Netherlands Society for Statistics and Operations Research
Bibliographic data for series maintained by Wiley Content Delivery ().