Reinforcement learning for frequency regulation control and simulation strategy optimization of pumped storage units

Jihong Kong, Yanqing Yang, Huaijie Ji, Hao Xu, Shiming Cheng and Jianlu Li

International Journal of Low-Carbon Technologies, 2025, vol. 20, 1818-1829

Abstract: The growing reliance on renewable energy in power grids introduces significant challenges to frequency stability due to its intermittent and unpredictable nature. Pumped storage units are vital for mitigating these issues, but traditional control methods often fail to adapt to dynamic grid conditions. This study introduces a reinforcement learning (RL)-based control approach to optimize frequency regulation in pumped storage units. We developed a multi-agent deep RL framework using the Deep Deterministic Policy Gradient algorithm with the Adam optimizer, integrating operational characteristics and dynamic interactions. Multi-source data fusion enhances the robustness of control decisions across diverse conditions. Experimental results show that our method reduces maximum frequency deviation by 40.0%–44.4%, mean frequency deviation by 33.3%–45.5%, and frequency recovery time by 33.1%–42.0% compared to traditional proportional-integral-derivative control in various operating scenarios. Frequency fluctuation count is halved, and the method achieves convergence in eight iterations with a computation time of 0.100 s, outperforming genetic algorithms and particle swarm optimization. This RL-based strategy significantly improves frequency stability, response speed, and energy efficiency, providing a scalable solution for renewable-heavy power systems.

Keywords: pumped storage unit; reinforcement learning; frequency control; strategy optimization; simulation strategy (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/ijlct/ctaf117 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:ijlctc:v:20:y:2025:i::p:1818-1829.

Access Statistics for this article

International Journal of Low-Carbon Technologies is currently edited by Saffa B. Riffat

More articles in International Journal of Low-Carbon Technologies from Oxford University Press
Bibliographic data for series maintained by Oxford University Press ().