A deep model for short-term load forecasting applying a stacked autoencoder based on LSTM supported by a multi-stage attention mechanism

Zahra Fazlipour, Elaheh Mashhour and Mahmood Joorabian

Applied Energy, 2022, vol. 327, issue C, No S0306261922013204

Abstract: This paper presents an innovative univariate Deep LSTM-based Stacked Autoencoder (DLSTM-SAE) model for short-term load forecasting, equipped with a Multi-Stage Attention Mechanism (MSAM), including an input AM and several temporal AM in the pre-training phase. The input AM is used to capture the high-impact load sequence time steps of univariate input data. It should be noted that the model's performance is improved by increasing the network depth; however, finding the optimal network parameters is a challenging task due to the random assignment of the initial weights of the network. An unsupervised greedy layer-wise pre-training structure equipped with the MSAM is expanded to solve setting the random initial weight problem of the DLSTM-SAE model. The multi-stage temporal AM in the pre-training structure leads the DLSTM-SAE to properly learn the time dependencies related to remarkably long sequence input data and capture the temporal merit features lied in the LSTM memory. The performance of the proposed model is evaluated through various comparative tests with current prevalent models using actual energy market data New England ISO using three criteria indexes. The results show the superiority of the proposed model and its robustness in offline and online load forecasting.

Keywords: Deep learning; Attention mechanism; Short-term load forecasting; LSTM; Stacked autoencoder (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (13)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261922013204
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:327:y:2022:i:c:s0306261922013204

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2022.120063

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().