Multiple-Reservoir Hierarchical Echo State Network

Shuxian Lun (), Zhenduo Sun, Ming Li () and Lei Wang
Additional contact information
Shuxian Lun: School of Control Science and Engineering, Bohai University, Jinzhou 121013, China
Zhenduo Sun: School of Control Science and Engineering, Bohai University, Jinzhou 121013, China
Ming Li: School of Control Science and Engineering, Bohai University, Jinzhou 121013, China
Lei Wang: School of Control Science and Engineering, Bohai University, Jinzhou 121013, China

Mathematics, 2023, vol. 11, issue 18, 1-12

Abstract: Leaky Integrator Echo State Network (Leaky-ESN) is a useful training method for handling time series prediction problems. However, the singular coupling of all neurons in the reservoir makes Leaky-ESN less effective for sophisticated learning tasks. In this paper, we propose a new improvement to the Leaky-ESN model called the Multiple-Reservoir Hierarchical Echo State Network (MH-ESN). By introducing a new mechanism for constructing the reservoir, the efficiency of the network in handling training tasks is improved. The hierarchical structure is used in the process of constructing the reservoir mechanism of MH-ESN. The MH-ESN consists of multiple layers, each comprising a multi-reservoir echo state network model. The sub-reservoirs within each layer are linked via principal neurons, which mimics the functioning of a biological neural network. As a result, the coupling among neurons in the reservoir is decreased, and the internal dynamics of the reservoir are improved. Based on the analysis results, the MH-ESN exhibits significantly better prediction accuracy than Leaky-ESN for complex time series prediction.

Keywords: Leaky-ESN; reservoir; multi-reservoirs; MH-ESN; main neurons; time series prediction (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/18/3961/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/18/3961/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:18:p:3961-:d:1242307

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().