A deep residual compensation extreme learning machine and applications

Yinghao Chen, Xiaoliang Xie, Tianle Zhang, Jiaxian Bai and Muzhou Hou

Journal of Forecasting, 2020, vol. 39, issue 6, 986-999

Abstract: The extreme learning machine (ELM) is a type of machine learning algorithm for training a single hidden layer feedforward neural network. Randomly initializing the weight between the input layer and the hidden layer and the threshold of each hidden layer neuron, the weight matrix of the hidden layer can be calculated by the least squares method. The efficient learning ability in ELM makes it widely applicable in classification, regression, and more. However, owing to some unutilized information in the residual, there are relatively huge prediction errors involving ELM. In this paper, a deep residual compensation extreme learning machine model (DRC‐ELM) of multilayer structures applied to regression is presented. The first layer is the basic ELM layer, which helps in obtaining an approximation of the objective function by learning the characteristics of the sample. The other layers are the residual compensation layers in which the learned residual is corrected layer by layer to the predicted value obtained in the previous layer by constructing a feature mapping between the input layer and the output of the upper layer. This model is applied to two practical problems: gold price forecasting and airfoil self‐noise prediction. We used the DRC‐ELM with 50, 100, and 200 residual compensation layers respectively for experiments, which show that DRC‐ELM does better in generalization and robustness than classical ELM, improved ELM models such as GA‐RELM and OS‐ELM, and other traditional machine learning algorithms such as support vector machine (SVM) and back‐propagation neural network (BPNN).

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://doi.org/10.1002/for.2663

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:jforec:v:39:y:2020:i:6:p:986-999

Access Statistics for this article

Journal of Forecasting is currently edited by Derek W. Bunn

More articles in Journal of Forecasting from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().