Handling Computation Hardness and Time Complexity Issue of Battery Energy Storage Scheduling in Microgrids by Deep Reinforcement Learning

Zeyue Sun, Mohsen Eskandari (), Chaoran Zheng and Ming Li
Additional contact information
Zeyue Sun: School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, NSW 2052, Australia
Mohsen Eskandari: School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, NSW 2052, Australia
Chaoran Zheng: School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, NSW 2052, Australia
Ming Li: School of Electrical Engineering and Telecommunications, University of New South Wales, Sydney, NSW 2052, Australia

Energies, 2022, vol. 16, issue 1, 1-20

Abstract: With the development of microgrids (MGs), an energy management system (EMS) is required to ensure the stable and economically efficient operation of the MG system. In this paper, an intelligent EMS is proposed by exploiting the deep reinforcement learning (DRL) technique. DRL is employed as the effective method for handling the computation hardness of optimal scheduling of the charge/discharge of battery energy storage in the MG EMS. Since the optimal decision for charge/discharge of the battery depends on its state of charge given from the consecutive time steps, it demands a full-time horizon scheduling to obtain the optimum solution. This, however, increases the time complexity of the EMS and turns it into an NP-hard problem. By considering the energy storage system’s charging/discharging power as the control variable, the DRL agent is trained to investigate the best energy storage control method for both deterministic and stochastic weather scenarios. The efficiency of the strategy suggested in this study in minimizing the cost of purchasing energy is also shown from a quantitative perspective through programming verification and comparison with the results of mixed integer programming and the heuristic genetic algorithm (GA).

Keywords: battery energy storage systems; deep reinforcement learning; energy management system; microgrid; optimization; renewable energy resources (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.mdpi.com/1996-1073/16/1/90/pdf (application/pdf)
https://www.mdpi.com/1996-1073/16/1/90/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:16:y:2022:i:1:p:90-:d:1010650

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().