Hybrid data-driven method for low-carbon economic energy management strategy in electricity-gas coupled energy systems based on transformer network and deep reinforcement learning

Bin Zhang, Weihao Hu, Xiao Xu, Zhenyuan Zhang and Zhe Chen

Energy, 2023, vol. 273, issue C

Abstract: Because of their attractive economic and environmental benefits, integrated energy systems (IESs), especially electricity-gas coupled energy systems (EGCESs), have received great interest. In this study, to minimize carbon trading and generation costs, a model-free deep-reinforcement-learning (DRL) method is integrated into the low-carbon economic autonomous energy management system of an EGCES. Unlike previous works, this work proposes an innovative transformer-deep deterministic policy gradient (TDDPG) that combines the superior feature extraction ability of the transformer network with the strong decision-making ability of a state-of-the-art TDDPG. The proposed method is tailored to the specific energy management problem to meet the requirements of multi-dimensional and continuous control. To validate the advantages of the TDDPG, the proposed method is compared with benchmark optimization methods. The simulation results illustrate that TDDPG performs more effectively than the examined DRL approaches in terms of optimizing low-carbon and economy targets, computation efficiency, and optimization of the results. Besides, the TDDPG method achieves lower average comprehensive costs than DDPG and requires less training time for real-time energy scheduling.

Keywords: Deep reinforcement learning; Neural network; Energy management system; Integrated energy system; Low-carbon (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223005777
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:273:y:2023:i:c:s0360544223005777

DOI: 10.1016/j.energy.2023.127183

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().