On the Benefits of Using Metaheuristics in the Hyperparameter Tuning of Deep Learning Models for Energy Load Forecasting

Nebojsa Bacanin, Catalin Stoean (), Miodrag Zivkovic, Miomir Rakic, Roma Strulak-Wójcikiewicz and Ruxandra Stoean
Additional contact information
Nebojsa Bacanin: Faculty of Informatics and Computing, Singidunum University, Danijelova 32, 11010 Belgrade, Serbia
Catalin Stoean: Department of Computer Science, University of Craiova, A.I.Cuza, 13, 200585 Craiova, Romania
Miodrag Zivkovic: Faculty of Informatics and Computing, Singidunum University, Danijelova 32, 11010 Belgrade, Serbia
Miomir Rakic: Faculty of Informatics and Computing, Singidunum University, Danijelova 32, 11010 Belgrade, Serbia
Roma Strulak-Wójcikiewicz: Faculty of Economics and Transport Engineering, Maritime University of Szczecin, Wały Chrobrego 1/2, 70-500 Szczecin, Poland
Ruxandra Stoean: Department of Computer Science, University of Craiova, A.I.Cuza, 13, 200585 Craiova, Romania

Energies, 2023, vol. 16, issue 3, 1-21

Abstract: An effective energy oversight represents a major concern throughout the world, and the problem has become even more stringent recently. The prediction of energy load and consumption depends on various factors such as temperature, plugged load, etc. The machine learning and deep learning (DL) approaches developed in the last decade provide a very high level of accuracy for various types of applications, including time-series forecasting. Accordingly, the number of prediction models for this task is continuously growing. The current study does not only overview the most recent and relevant DL for energy supply and demand, but it also emphasizes the fact that not many recent methods use parameter tuning for enhancing the results. To fill the abovementioned gap, in the research conducted for the purpose of this manuscript, a canonical and straightforward long short-term memory (LSTM) DL model for electricity load is developed and tuned for multivariate time-series forecasting. One open dataset from Europe is used as a benchmark, and the performance of LSTM models for a one-step-ahead prediction is evaluated. Reported results can be used as a benchmark for hybrid LSTM-optimization approaches for multivariate energy time-series forecasting in power systems. The current work highlights that parameter tuning leads to better results when using metaheuristics for this purpose in all cases: while grid search achieves a coefficient of determination ( R 2 ) of 0.9136, the metaheuristic that led to the worst result is still notably better with the corresponding score of 0.9515.

Keywords: metaheuristic optimizers; deep learning; long short-term memory networks; energy load prediction; time series (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/1996-1073/16/3/1434/pdf (application/pdf)
https://www.mdpi.com/1996-1073/16/3/1434/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:16:y:2023:i:3:p:1434-:d:1053690

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().