Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning

Jiawen Li, Tao Yu and Xiaoshun Zhang

Applied Energy, 2022, vol. 306, issue PA, No S0306261921012137

Abstract: To dynamically balance multiple energy fluctuations in a multi-area integrated energy system (IES), a coordinated power control framework, named distributed intelligent coordinated automatic generation control (DIC-AGC), is constructed among different areas during load frequency control (LFC). Furthermore, an evolutionary imitation curriculum multi-agent deep deterministic policy gradient (EIC-MADDPG) algorithm is proposed as a novel deep reinforcement learning algorithm to realize coordinated control and improve the performance of DIC-AGC in the performance-based frequency regulation market. EIC-MADDPG, which combines imitation learning and curriculum learning, can adaptively derive the optimal coordinated control strategies for multiple areas of LFC controllers through centralized learning and decentralized implementation. The simulation of a four-area LFC-IES model on the China Southern Grid (CSG) demonstrates the effectiveness of the proposed method in maximizing control performance while minimizing regulation mileage payment in every area against stochastic load and renewable power fluctuations.

Keywords: Performance-based frequency regulation market; Distributed intelligent coordinated automatic generation control (DIC-AGC); Evolutionary imitation curriculum multi-agent double delayed deep deterministic policy gradient algorithm (EIC-MADDPG) (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (29)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261921012137
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:306:y:2022:i:pa:s0306261921012137

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2021.117900

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().