Long-term microgrid expansion planning with resilience and environmental benefits using deep reinforcement learning

Kexin Pang, Jian Zhou, Stamatis Tsianikas, David W. Coit and Yizhong Ma

Renewable and Sustainable Energy Reviews, 2024, vol. 191, issue C

Abstract: Microgrid plays an increasingly important role to enhance power resilience and environmental protection regarding greenhouse gas emission reduction through the widespread applications of distributed and renewable energy. Because of the steady growth of load demand, the strict power resilience requirements and the pressing need of carbon emission reduction, microgrid expansion planning considering those factors has become a currently topical topic. In this study, a new framework for long-term microgrid expansion planning, in which a microgrid serves as a backup power system in the event of main grid outages from the perspectives of economy, resilience and greenhouse gas emission, is proposed. Deep reinforcement learning method is used to solve this dynamic and stochastic optimization problem by taking into account various uncertainties and constraints for the long-range planning. Case studies of 20-year microgrid expansion planning using actual data are conducted. The simulation results demonstrate the effectiveness of the proposed framework on reducing greenhouse gas emissions and total cost including economic losses resulting from power grid outages, investment and operating cost of microgrid entities. In addition, the impact of customer load demand and microgrid entities price on optimal planning policies is discussed. The results demonstrate that microgrid expansion planning can be effectively adapted to different levels of load demand and different scenarios of price changes under the proposed framework. This work is helpful for decision makers to implement cost-effective and power resilient microgrid expansion planning with greenhouse gas emission reduction benefits in the long term.

Keywords: Reinforcement learning; Microgrid expansion planning; Optimization; Greenhouse gas emission; System resilience (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1364032123009267
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:rensus:v:191:y:2024:i:c:s1364032123009267

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/bibliographic
http://www.elsevier. ... 600126/bibliographic

DOI: 10.1016/j.rser.2023.114068

Access Statistics for this article

Renewable and Sustainable Energy Reviews is currently edited by L. Kazmerski

More articles in Renewable and Sustainable Energy Reviews from Elsevier
Bibliographic data for series maintained by Catherine Liu ().