Kibria–Lukman-Type Estimator for Regularization and Variable Selection with Application to Cancer Data

Adewale Folaranmi Lukman, Jeza Allohibi (), Segun Light Jegede, Emmanuel Taiwo Adewuyi, Segun Oke and Abdulmajeed Atiah Alharbi
Additional contact information
Adewale Folaranmi Lukman: Department of Mathematics, University of North Dakota, Grand Forks, ND 58202, USA
Jeza Allohibi: Department of Mathematics, Faculty of Science, Taibah University, Al-Madinah Al-Munawara 42353, Saudi Arabia
Segun Light Jegede: Department of Mathematical Sciences, Kent State University, Kent, OH 44242, USA
Emmanuel Taiwo Adewuyi: Department of Statistics, Ladoke Akintola University of Technology, Ogbomoso 212102, Nigeria
Segun Oke: Department of Physics, Chemistry and Mathematics, Alabama A&M University, Huntsville, AL 35762, USA
Abdulmajeed Atiah Alharbi: Department of Mathematics, Faculty of Science, Taibah University, Al-Madinah Al-Munawara 42353, Saudi Arabia

Mathematics, 2023, vol. 11, issue 23, 1-11

Abstract: Following the idea presented with regard to the elastic-net and Liu-LASSO estimators, we proposed a new penalized estimator based on the Kibria–Lukman estimator with L1-norms to perform both regularization and variable selection. We defined the coordinate descent algorithm for the new estimator and compared its performance with those of some existing machine learning techniques, such as the least absolute shrinkage and selection operator (LASSO), the elastic-net, Liu-LASSO, the GO estimator and the ridge estimator, through simulation studies and real-life applications in terms of test mean squared error (TMSE), coefficient mean squared error (βMSE), false-positive (FP) coefficients and false-negative (FN) coefficients. Our results revealed that the new penalized estimator performs well for both the simulated low- and high-dimensional data in simulations. Also, the two real-life results show that the new method predicts the target variable better than the existing ones using the test RMSE metric.

Keywords: regularization; variable selection; elastic-net; LASSO; ridge estimator; Liu-LASSO (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/23/4795/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/23/4795/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:23:p:4795-:d:1289070

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().