Identification and Correction of Abnormal, Incomplete Power Load Data in Electricity Spot Market Databases

Jingjiao Li, Yifan Lv (), Zhou Zhou, Zhiwen Du, Qiang Wei and Ke Xu
Additional contact information
Jingjiao Li: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China
Yifan Lv: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China
Zhou Zhou: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China
Zhiwen Du: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China
Qiang Wei: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China
Ke Xu: School of Electric Power Engineering, Nanjing Institute of Technology, Nanjing 211167, China

Energies, 2025, vol. 18, issue 1, 1-14

Abstract: The development of electricity spot markets necessitates more refined and accurate load forecasting capabilities to enable precise dispatch control and the creation of new trading products. Accurate load forecasting relies on high-quality historical load data, with complete load data serving as the cornerstone for both forecasting and transactions in electricity spot markets. However, historical load data at the distribution network or user level often suffers from anomalies and missing values. Data-driven methods have been widely adopted for anomaly detection due to their independence from prior expert knowledge and precise physical models. Nevertheless, single network architectures struggle to adapt to the diverse load characteristics of distribution networks or users, hindering the effective capture of anomaly patterns. This paper proposes a PLS-VAE-BiLSTM-based method for anomaly identification and correction in load data by combining the strengths of Variational Autoencoders (VAE) and Bidirectional Long Short-Term Memory Networks (BiLSTM). This method begins with data preprocessing, including normalization and preliminary missing value imputation based on Partial Least Squares (PLS). Subsequently, a hybrid VAE-BiLSTM model is constructed and trained on a loaded dataset incorporating influencing factors to learn the relationships between different data features. Anomalies are identified and corrected by calculating the deviation between the model’s reconstructed values and the actual values. Finally, validation on both public and private datasets demonstrates that the PLS-VAE-BiLSTM model achieves average performance metrics of 98.44% precision, 94% recall rate, and 96.05% F1 score. Compared with VAE-LSTM, PSO-PFCM, and WTRR models, the proposed method exhibits superior overall anomaly detection performance.

Keywords: anomaly identification and correction; bidirectional long short-term memory network; power load data; partial least square; variational auto-encoders (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1996-1073/18/1/176/pdf (application/pdf)
https://www.mdpi.com/1996-1073/18/1/176/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:18:y:2025:i:1:p:176-:d:1559901

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().