On the non‐negative garrotte estimator

Ming Yuan and Yi Lin

Journal of the Royal Statistical Society Series B, 2007, vol. 69, issue 2, 143-161

Abstract: Summary. We study the non‐negative garrotte estimator from three different aspects: consistency, computation and flexibility. We argue that the non‐negative garrotte is a general procedure that can be used in combination with estimators other than the original least squares estimator as in its original form. In particular, we consider using the lasso, the elastic net and ridge regression along with ordinary least squares as the initial estimate in the non‐negative garrotte. We prove that the non‐negative garrotte has the nice property that, with probability tending to 1, the solution path contains an estimate that correctly identifies the set of important variables and is consistent for the coefficients of the important variables, whereas such a property may not be valid for the initial estimators. In general, we show that the non‐negative garrotte can turn a consistent estimate into an estimate that is not only consistent in terms of estimation but also in terms of variable selection. We also show that the non‐negative garrotte has a piecewise linear solution path. Using this fact, we propose an efficient algorithm for computing the whole solution path for the non‐negative garrotte. Simulations and a real example demonstrate that the non‐negative garrotte is very effective in improving on the initial estimator in terms of variable selection and estimation accuracy.

Date: 2007
References: Add references at CitEc
Citations: View citations in EconPapers (35)

Downloads: (external link)
https://doi.org/10.1111/j.1467-9868.2007.00581.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:69:y:2007:i:2:p:143-161

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().