Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning

Luca Pinciroli, Piero Baraldi, Michele Compare and Enrico Zio

Applied Energy, 2023, vol. 352, issue C, No S0306261923013119

Abstract: The operation of microgrids, i.e., energy systems composed of distributed energy generation, local loads and energy storage capacity, is challenged by the variability of intermittent energy sources and demands, the stochastic occurrence of unexpected outages of the conventional grid and the degradation of the Energy Storage System (ESS), which is strongly influenced by its operating conditions. To effectively address these challenges, a novel method for combined operation and maintenance management of ESS has been developed. Unlike the currently available solutions, which typically address the one-day-ahead scheduling problem, the present work considers, for the first time, the realistic case of a microgrid in which the ESS degrades and unexpected outages of the conventional grid can occur along the long-time horizons of the entire microgrid lifetimes. The proposed method, which is based on deep reinforcement learning, is tested on a simulated grid-connected microgrid of a residential building equipped with photovoltaic modules and an ESS. The method outperforms other state-of-the-art approaches based on heuristics and metaheuristics by increasing the profit by 15% and reducing the average number of ESS replacements during its lifetime. Therefore, it can be concluded that the proposed DRL-based framework allows achieving prescriptive maintenance since the suggested actions are optimal from the point of view of effectively maximizing the profit and minimizing the maintenance interventions over the entire lifetime of the microgrid.

Keywords: Microgrid; Energy storage systems; Operation and maintenance; Optimization; Deep reinforcement learning (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261923013119
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013119

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2023.121947

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().