Reinforcement learning-based optimal scheduling model of battery energy storage system at the building level

Hyuna Kang, Seunghoon Jung, Hakpyeong Kim, Jaewon Jeoung and Taehoon Hong

Renewable and Sustainable Energy Reviews, 2024, vol. 190, issue PA

Abstract: Installing the battery energy storage system (BESS) and optimizing its schedule to effectively address the intermittency and volatility of photovoltaic (PV) systems has emerged as a critical research challenge. Nonetheless, some existing studies still have limitations in terms of the efficiency of the BESS scheduling due to the lack of comprehensive consideration of diverse user objectives. As a response to this gap, this study aimed to develop a reinforcement learning (RL)-based optimal scheduling model to better reflect the continuous behaviors in the complex real world. To this end, focused on residential buildings connected to the grid and equipped with a BESS and PV system, its optimal scheduling models were developed using four algorithms from among the various RL techniques according to training methods. The results of the case study showed that the developed RL-based optimal scheduling model using Proximal Policy Optimization (PPO) can be applied to effectively operate the BESS with a PV system, considering possible uncertainties in the real world. The case study demonstrated the effectiveness and feasibility of the developed RL-based optimal scheduling model. Compared to other algorithms, the PPO-based RL model has better decision-making for optimal BESS scheduling strategies to maximize their self-sufficiency rate and economic profits by coping with changing variables in the real world. Therefore, the RL-based BESS scheduling model will offer an optimal solution, specifically tailored for use within a virtual power plant, where numerous buildings continuously share electricity.

Keywords: Battery energy storage system; PV system; Reinforcement learning; Optimal scheduling (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1364032123009127
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:rensus:v:190:y:2024:i:pa:s1364032123009127

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/bibliographic
http://www.elsevier. ... 600126/bibliographic

DOI: 10.1016/j.rser.2023.114054

Access Statistics for this article

Renewable and Sustainable Energy Reviews is currently edited by L. Kazmerski

More articles in Renewable and Sustainable Energy Reviews from Elsevier
Bibliographic data for series maintained by Catherine Liu ().