Research on the multi-area cooperative control method for novel power systems

Lei Xi, Yu Shi, Yue Quan and Zhihong Liu

Energy, 2024, vol. 313, issue C

Abstract: As new energy sources increasingly penetrate novel power systems, the coordinated control of frequency regulation units has become more challenging, leading to the degraded performance of power grid control. The automatic generation control methods based on traditional reinforcement learning overly depend on exploration, making it difficult quickly obtain optimal solutions for multi-area cooperative control and resulting in suboptimal performance. To address this issue, this paper proposes a multi-area coordinated control method using a greedy actor-critic algorithm enhanced with expert experience replay. This method decouple the role of entropy for exploration and policy collapse, utilizing a proposal policy to secure high-value actions for policy updates. Thus the exploration and exploitation are balanced and the local optima is avoided. Additionally, the expert experience replay collects expert demonstration data with high-value to assist the learning of multi-agent. Therefore, the meaningless exploration in early training is reduced and the rapid attainment of optimal solutions is facilitated. This paper validates the proposed method through simulations on the model of the improved IEEE standard two-area load frequency control and the model of the Sichuan, Chongqing, and Hubei three-area. Compared with other various reinforcement learning methods, the proposed method is demonstrated with superior control performance.

Keywords: Reinforcement learning; Automatic generation control; Multi-area cooperative control; Greedy actor-critic; Expert experience replay (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224036909
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:313:y:2024:i:c:s0360544224036909

DOI: 10.1016/j.energy.2024.133912

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().