Establishing Echo State Network in Order to Be Used in Online Application

Javad Saadat (), Mohsen Farshad (), Hussein Eliasi () and Kazem Shokoohi Mehr ()
Additional contact information
Javad Saadat: University of Birjand
Mohsen Farshad: University of Birjand
Hussein Eliasi: University of Birjand
Kazem Shokoohi Mehr: University of Birjand

SN Operations Research Forum, 2025, vol. 6, issue 3, 1-15

Abstract: Abstract Reservoir computing is an efficient computational framework which provides an appropriate approach for training recurrent neural networks. Echo state network is a simple and new method for reservoir computing models which consists of three input layers, a dynamic reservoir, and an output layer. The weight of connections entered into the reservoir is randomly generated and remains fixed in the training process, so it is possible to use many units in the dynamic reservoir to generate more dynamics. In practice, it can be seen that the performance of some dynamic reservoir units is similar to each other. The similarity of the reservoir units’ performance causes a large eigenvalue spread of the network autocorrelation matrix. Therefore, the convergence speed of the online training algorithm is slowed down or the algorithm does not converge. In this study, using the mutual correlation criterion, similar dynamics are found and one (as a representative) from each group of units with similar functions and other similar units are disconnected from the output layer. In this case, without losing the dynamic diversity of the reservoir, the number of trainable connections is reduced. In addition to reducing the number of calculations, the proposed method reduces the eigenvalue spread of the autocorrelation matrix of the reservoir states. The proposed method simultaneously increases the speed of convergence and the accuracy of echo state network online training. At the end, Mackey–Glass time series prediction is used to show the efficiency of the proposed method.

Keywords: Echo state network; Least mean square algorithm; Mackey–Glass time series; Online training; Reservoir computing; Time series prediction (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s43069-025-00514-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:snopef:v:6:y:2025:i:3:d:10.1007_s43069-025-00514-0

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/43069

DOI: 10.1007/s43069-025-00514-0

Access Statistics for this article

SN Operations Research Forum is currently edited by Marco Lübbecke

More articles in SN Operations Research Forum from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().