Shrinkage Approaches for Ridge-Type Estimators Under Multicollinearity

Marwan Al-Momani (), Bahadır Yüzbaşı, Mohammad Saleh Bataineh, Rihab Abdallah and Athifa Moideenkutty
Additional contact information
Marwan Al-Momani: Department of Mathematics, College of Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates
Bahadır Yüzbaşı: Department of Econometrics, Inonu University, Malatya 44280, Turkey
Mohammad Saleh Bataineh: Department of Mathematics, College of Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates
Rihab Abdallah: Department of Mathematics, College of Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates
Athifa Moideenkutty: Department of Mathematics, College of Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates

Mathematics, 2025, vol. 13, issue 22, 1-31

Abstract: Multicollinearity is a common issue in regression analyses that occurs when some predictor variables are highly correlated, leading to unstable least squares estimates of model parameters. Various estimation strategies have been proposed to address this problem. In this study, we enhanced a ridge-type estimator by incorporating pretest and shrinkage techniques. We conducted an analytical comparison to evaluate the performance of the proposed estimators in terms of their bias, quadratic risk, and numerical performance using both simulated and real data. Additionally, we assessed several penalization methods and three machine learning algorithms to facilitate a comprehensive comparison. Our results demonstrate that the proposed estimators outperformed the standard ridge-type estimator with respect to the mean squared error of the simulated data and the mean squared prediction error of two real data applications.

Keywords: ridge-type estimation; shrinkage; pretest; penalization methods; machine learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/22/3733/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/22/3733/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:22:p:3733-:d:1799486

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().