Bootstrap confidence interval of ridge regression in linear regression model: A comparative study via a simulation study

M. Revan Özkale and Hüsniye Altuner

Communications in Statistics - Theory and Methods, 2023, vol. 52, issue 20, 7405-7441

Abstract: It is well known that the variances of the least squares estimates are large and they can be far away from their true values in the case of multicollinearity. Therefore, the ridge regression method can be used as an alternative to the least squares method. However, the ridge estimator has a disadvantage that its distribution is unknown, so only asymptotic confidence intervals are obtained. The purpose of this paper is to study the impact of several ridge regularization parameters on the mean interval lengths of the confidence intervals and coverage probabilities constructed by the ridge estimator. A bootstrap method for the selection of ridge regularization parameter is used as well as the parametric methods. In order to compare the confidence intervals, standard normal approximation, student-t approximation and bootstrap methods are used and comparison is illustrated via real data and simulation study. The simulation study shows that the bootstrap choice of ridge regularization parameter yields narrower standard normal approximated confidence intervals than the PRESS choice of ridge regularization parameter but wider standard normal approximated, student-t approximated and bootstrap confidence intervals than the GCV choice of ridge regularization parameter.

Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2022.2045024 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:52:y:2023:i:20:p:7405-7441

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2022.2045024

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().