Optimal regression parameter-specific shrinkage by plug-in estimation

Yoonsuh Jung

Communications in Statistics - Theory and Methods, 2020, vol. 49, issue 18, 4490-4505

Abstract: One benefit of the bias-variance tradeoff is that regression estimators do not have to be strictly unbiased. However, to take full advantage of allowing bias, shrinkage regression estimators require that the appropriate level of bias is chosen carefully. Because the conventional grid search for the shrinkage parameters requires heavy computation, it is practically difficult to incorporate more than two shrinkage parameters. In this paper, we propose a class of shrinkage regression estimators which differently shrink each regression parameter. For this purpose, we set the number of shrinkage parameters to be the same as the number of regression coefficients. The ideal shrinkage for each parameter is suggested, meaning that a burdensome tuning process is not required for each parameter. The n-consistency and oracle property of the suggested estimators are established. The application of the proposed methods to simulated and real data sets produces the favorable performance of the suggested regression shrinkage methods without the need for a grid search of the entire parameter space.

Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2019.1602649 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:49:y:2020:i:18:p:4490-4505

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2019.1602649

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().