Two-layered optimal scheduling under a semi-model architecture of hydro-wind-solar multi-energy systems with hydrogen storage

Yonggang Li, Yaotong Su, Yuanjin Zhang, Weinong Wu and Lei Xia

Energy, 2024, vol. 313, issue C

Abstract: With the development of artificial intelligence (AI), it is a research hotspot using model-free deep reinforcement learning (DRL) to improve the intelligent level of hydro-wind-solar-hydrogen systems. However, the extent to which DRL should be applied to achieve maximum economic benefits has not yet been quantified. Additionally, as hydrogen storage station charging and discharging times increase, traditional scheduling strategies face new challenges. In this study, the optimal scheduling is divided into two layers to adapt to the particularity of hydrogen storage system (HSS). The model-free and model-based optimization architecture is established for the upper and lower layers of the scheduling, respectively, called semi-model architecture (SMA). At the upper layer of SMA, the DRL learns environmental information, optimizing energy scheduling by predicting loads under demand response mechanisms and renewable energy output. The lower layer employs model predictive control (MPC) to optimize energy storage, using a 1-h scheduling time scale and a 4-h rolling optimization scale for HSS. The simulations verify that the 4-h rolling optimization we proposed brings shorter simulation times and higher economic benefits compared to other time scales. The SMA-based scheduling improves economic efficiency by 40 % and 23 % compared to model-free DRL-based scheduling using DoubleDQN and SARSA algorithms, respectively.

Keywords: Renewable energy; Microgrid; Hydrogen energy storage; Deep reinforcement learning; Optimization scheduling (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224038933
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:313:y:2024:i:c:s0360544224038933

DOI: 10.1016/j.energy.2024.134115

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().