Ridging out many covariates

Stanislav Anatolyev

Communications in Statistics - Theory and Methods, 2025, vol. 54, issue 24, 8064-8078

Abstract: The article considers a conditionally heteroskedastic linear regression setup with few regressors of interest and many nuisance covariates. We propose to subject the parameters corresponding to those nuisance covariates to a generalized ridge shrinkage. We show that under the assumption of dense random effects from the nuisance covariates, the ridge-out estimator of the parameters of interest is conditionally unbiased, and we derive the optimal ridge intensity that delivers conditional efficiency. When tight structures on the variance of random effects are imposed, the asymptotic variance of the ridge-out estimator, under the dimension asymptotics, may be arbitrarily smaller than that of the least squares estimator. We also demonstrate how the optimal ridge-out estimator can be implemented under tight structures on the variance of random effects and run simulation experiments where significant efficiency gains are possible to reach.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2025.2490691 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:54:y:2025:i:24:p:8064-8078

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2025.2490691

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().