Robust low-rank multiple kernel learning with compound regularization

He Jiang, Changqi Tao, Yao Dong and Ren Xiong

European Journal of Operational Research, 2021, vol. 295, issue 2, 634-647

Abstract: Kernel learning is widely used in nonlinear models during the implementation of forecasting tasks in analytics. However, existing forecasting models lack robustness and accuracy. Therefore, in this study, a novel supervised forecasting approach based on robust low-rank multiple kernel learning with compound regularization is investigated. The proposed method extracts the benefits from robust regression, multiple kernel learning with low-rank approximation, and sparse learning systems. Unlike existing hybrid forecasting methods, which frequently combine different models in parallel, we embed a Huber or quantile loss function and a compound regularization composed of smoothly clipped absolute deviation and ridge regularizations in a support vector machine with predefined number of kernels. To select the optimal kernels, L1 penalization with positive constraint is also considered. The proposed model exhibits robustness, forecasting accuracy, and sparsity in the reproducing kernel Hilbert space. For computation, a simple algorithm is designed based on local quadratic approximation to implement the proposed method. Theoretically, the forecasting and estimation error bounds of the proposed estimators are derived under a null consistency assumption. Real data experiments using datasets from various scientific research fields demonstrate the superior performances of the proposed approach compared with other state-of-the-art competitors.

Keywords: Analytics; Robust estimation; Sparse learning; Multiple kernel learning; Compound regularization (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221720310675
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:295:y:2021:i:2:p:634-647

DOI: 10.1016/j.ejor.2020.12.024

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().