Energy Management of Electric–Hydrogen Coupled Integrated Energy System Based on Improved Proximal Policy Optimization Algorithm

Jingbo Zhao, Zhengping Gao and Zhe Chen ()
Additional contact information
Jingbo Zhao: State Grid Jiangsu Electric Power Co., Ltd., Research Institute, Nanjing 210023, China
Zhengping Gao: State Grid Jiangsu Electric Power Co., Ltd., Nanjing 210023, China
Zhe Chen: State Grid Jiangsu Electric Power Co., Ltd., Research Institute, Nanjing 210023, China

Energies, 2025, vol. 18, issue 15, 1-17

Abstract: The electric–hydrogen coupled integrated energy system (EHCS) is a critical pathway for the low-carbon transition of energy systems. However, the inherent uncertainties of renewable energy sources present significant challenges to optimal energy management in the EHCS. To address these challenges, this paper proposes an energy management method for the EHCS based on an improved proximal policy optimization (IPPO) algorithm. This method aims to overcome the limitations of traditional heuristic algorithms, such as low solution accuracy, and the inefficiencies of mathematical programming methods. First, a mathematical model for the EHCS is established. Then, by introducing the Markov decision process (MDP), this mathematical model is transformed into a deep reinforcement learning framework. On this basis, the state space and action space of the system are defined, and a reward function is designed to guide the agent to learn to the optimal strategy, which takes into account the constraints of the system. Finally, the efficacy and economic viability of the proposed method are validated through numerical simulation.

Keywords: proximal policy optimization algorithm; electric–hydrogen coupled integrated energy system; energy management; renewable energy (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/18/15/3925/pdf (application/pdf)
https://www.mdpi.com/1996-1073/18/15/3925/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:18:y:2025:i:15:p:3925-:d:1708192

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().