A Robust Variable Selection Method for Sparse Online Regression via the Elastic Net Penalty

Wentao Wang, Jiaxuan Liang, Rong Liu, Yunquan Song and Min Zhang ()
Additional contact information
Wentao Wang: School of Science, China University of Petroleum, Qingdao 266580, China
Jiaxuan Liang: School of Science, China University of Petroleum, Qingdao 266580, China
Rong Liu: School of Science, China University of Petroleum, Qingdao 266580, China
Yunquan Song: School of Science, China University of Petroleum, Qingdao 266580, China
Min Zhang: School of Science, China University of Petroleum, Qingdao 266580, China

Mathematics, 2022, vol. 10, issue 16, 1-18

Abstract: Variable selection has been a hot topic, with various popular methods including lasso, SCAD, and elastic net. These penalized regression algorithms remain sensitive to noisy data. Furthermore, “concept drift” fundamentally distinguishes streaming data learning from batch learning. This article presents a method for noise-resistant regularization and variable selection in noisy data streams with multicollinearity, dubbed canal-adaptive elastic net, which is similar to elastic net and encourages grouping effects. In comparison to lasso, the canal adaptive elastic net is especially advantageous when the number of predictions ( p ) is significantly larger than the number of observations ( n ), and the data are multi-collinear. Numerous simulation experiments have confirmed that canal-adaptive elastic net has higher prediction accuracy than lasso, ridge regression, and elastic net in data with multicollinearity and noise.

Keywords: streaming data; variable selection; noise-resilient; online learning; elastic net (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/16/2985/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/16/2985/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:16:p:2985-:d:892073

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().