Electrical load forecasting based on variable T-distribution and dual attention mechanism

Jianguo Wang, Lincheng Han, Xiuyu Zhang, Yingzhou Wang and Shude Zhang

Energy, 2023, vol. 283, issue C

Abstract: Accurate load forecasting is essential for power system stability and grid dispatch optimization. However, this task is challenging due to the inherent instability and volatility of the load sequence. To address this problem, this paper proposes a novel load forecasting model that integrates periodicity detection, the variable t-distribution, and the dual attention mechanism. Periodicity detection has been incorporated into the self-attention mechanism for the first time, identifying the most significant period in the raw load sequence. Subsequently, the raw load sequence undergoes processing using empirical wavelet transform, resulting in a series of subsequences. A feature attention mechanism is then employed to extract relevant input features. Furthermore, a novel variable t-distribution distance matrix is introduced into the temporal self-attention mechanism, enhancing the influence of data at identical or nearby positions in other periods based on the length of the most significant period. This modification improves the capacity of the vanilla self-attention mechanism to effectively model the relationship between data at varying distances. The hyperparameters of the variable t-distribution are obtained through Bayesian hyperparameter optimization. Empirical evaluations on two datasets with distinct meteorological and load features show that the proposed model outperforms baseline models across all metrics.

Keywords: load forecasting; Variable t-distribution; Dual attention mechanism; Periodicity detection; Bayesian hyperparameter optimization (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223019631
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:283:y:2023:i:c:s0360544223019631

DOI: 10.1016/j.energy.2023.128569

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().