Outlier Detection and Correction in Smart Grid Energy Demand Data Using Sparse Autoencoders

Levi da Costa Pimentel, Ricardo Wagner Correia Guerra Filho, Juan Moises Mauricio Villanueva () and Yuri Percy Molina Rodriguez
Additional contact information
Levi da Costa Pimentel: Department of Electrical Engineering, Federal University of Paraíba, João Pessoa 58051-900, PB, Brazil
Ricardo Wagner Correia Guerra Filho: Department of Electrical Engineering, Federal University of Paraíba, João Pessoa 58051-900, PB, Brazil
Juan Moises Mauricio Villanueva: Department of Electrical Engineering, Federal University of Paraíba, João Pessoa 58051-900, PB, Brazil
Yuri Percy Molina Rodriguez: Department of Electrical Engineering, Federal University of Paraíba, João Pessoa 58051-900, PB, Brazil

Energies, 2024, vol. 17, issue 24, 1-23

Abstract: The implementation of smart grids introduces complexities where data quality issues, particularly outliers, pose significant challenges to accurate data analysis. This work develops an integrated methodology for the detection and correction of outliers in energy demand data, based on Artificial Neural Network autoencoders. The proposed approach is submitted across multiple scenarios using real-world data from a substation, where the influence of the variation in the number of outliers present in the database is evaluated, as well as the variation in their amplitudes on the functioning of the algorithms. The results provide an overview of the operation as well as demonstrate the effectiveness of the proposed methodology that manages to improve some indices achieved by previous works, reaching accuracy and F-score superior to 99% and 97%, respectively, for the detection algorithm, as well as a square root mean squared error (RMSE) and a mean absolute percentage error (MAPE) of less than 0.2 MW and 2%, respectively.

Keywords: smart grids; smart meters; outlier detection; autoencoders; artificial neural networks (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/17/24/6403/pdf (application/pdf)
https://www.mdpi.com/1996-1073/17/24/6403/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:17:y:2024:i:24:p:6403-:d:1547764

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().