Attention mechanism-based transfer learning model for day-ahead energy demand forecasting of shopping mall buildings

Yue Yuan, Zhihua Chen, Zhe Wang, Yifu Sun and Yixing Chen

Energy, 2023, vol. 270, issue C

Abstract: The forecasting performance of data-driven models decreases rapidly with a limited training dataset. Herein, we sought to solve this problem by developing an attention mechanism-based transfer learning model and comparing its predictive ability in day-ahead energy consumption with those of three direct learning models: artificial neural networks with auto-regression (AR-ANN), random forest with auto-regression (AR-RF), and long short-term memory neural network (LSTM). Our target building was a large-scale shopping mall in Harbin, with 2 years of monitored data. The 2-months to 1-year data selected from the first year and all data from the second year were used as the training and testing sets, respectively. These models predicted the target building's peak electricity demand (PED) and total energy consumption (TEC). The results showed that the proposed transfer learning model outperformed the three direct learning models when data were insufficient in the training set. Specifically, the direct prediction models' lowest PED and TEC prediction errors were 34.34% and 26.32%, respectively, with 2-month training data available. In comparison, the corresponding prediction errors of the proposed model were only 12.48% and 10.78%, respectively. This study demonstrated the excellent performance of the proposed model with limited data.

Keywords: Transfer learning; Attention mechanisms; Shopping mall building; Energy prediction (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223002724
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:270:y:2023:i:c:s0360544223002724

DOI: 10.1016/j.energy.2023.126878

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().