Deep Reinforcement Learning-Based Real-Time Energy Management for an Integrated Electric–Thermal Energy System

Qiang Shuai, Yue Yin (), Shan Huang and Chao Chen
Additional contact information
Qiang Shuai: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Yue Yin: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Shan Huang: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Chao Chen: College of Electrical Engineering, Sichuan University, Chengdu 610065, China

Sustainability, 2025, vol. 17, issue 2, 1-17

Abstract: Renewable energy plays a crucial role in achieving sustainable development and has the potential to meet humanity’s long-term energy requirements. Integrated electric–thermal energy systems are an important way to consume a high proportion of renewable energy. The intermittency and volatility of integrated electric–thermal energy systems make solving energy management optimization problems difficult. Thus, this paper proposes an energy management optimization method for an integrated electric–thermal energy system based on the improved proximal policy optimization algorithm, which effectively mitigates the problems of the traditional heuristic algorithms or mathematical planning methods with low accuracy and low solving efficiency. Meanwhile, the proposed algorithm enhances both the convergence speed and overall performance compared to the proximal policy optimization algorithm. This paper first establishes a mathematical model for the energy management of an integrated electric–thermal energy system. Then, the model is formulated as a Markov decision process, and a reward mechanism is designed to guide the agent to learn the uncertainty characteristics of renewable energy output and load consumption in the system through historical data. Finally, in the case study section, the proposed algorithm reduces the average running cost by 2.32% compared to the other algorithms discussed in this paper, thereby demonstrating its effectiveness and cost-efficiency.

Keywords: integrated electric–thermal energy system; energy management; renewable energy; deep reinforcement learning; improved proximal policy optimization algorithm (search for similar items in EconPapers)
JEL-codes: O13 Q Q0 Q2 Q3 Q5 Q56 (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2071-1050/17/2/407/pdf (application/pdf)
https://www.mdpi.com/2071-1050/17/2/407/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jsusta:v:17:y:2025:i:2:p:407-:d:1562054

Access Statistics for this article

Sustainability is currently edited by Ms. Alexandra Wu

More articles in Sustainability from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().