Safe deep reinforcement learning-assisted two-stage energy management for active power distribution networks with hydrogen fueling stations

Panggah Prabawa and Dae-Hyun Choi

Applied Energy, 2024, vol. 375, issue C, No S0306261924015538

Abstract: In a power-hydrogen coupled integrated energy system (PHCIES), hydrogen fueling stations (HFSs) with solar photovoltaic (PV) systems are crucial devices to support hydrogen demand and maintain a stable and near-zero pollutant emission-based PHCIES operation by producing a pollutant-free hydrogen. However, optimal operation management of HFSs is challenging because the electrolyzers, compressor, hydrogen storage system (HSS), and fuel cell in HFSs are interconnected and change dynamically under various operational environments. To resolve this issue, this paper presents a safe deep reinforcement learning (DRL)-assisted two-stage framework that ensures a reliable and economical PHCIES operation. In the first stage, day-ahead operational schedules of stand-alone PV systems, PV-enabled HFSs, on-load tap changers, and capacitor banks with hourly resolution are coordinated to minimize the system operation cost, electricity arbitrage cost, PV curtailment cost, and real power loss by solving a Volt-VAR control (VVC) optimization problem. In the second stage, a safe DRL algorithm with a 15-min resolution is employed to minimize the real power loss and maximize the HFS profit by rescheduling the reactive power of stand-alone PV systems and real/reactive power and hydrogen of HFSs. The proposed self-tuning adaptive safety module integrated in the DRL method ensures no violations of HSS’ state-of-hydrogen (SOH) and voltage magnitude in the PHCIES during the training process. Numerical examples conducted on a PHCIES (IEEE 33-bus system coupled with two PV-enabled HFSs) demonstrate the effectiveness of the proposed framework in terms of training convergence, SOH/voltage violation, real power loss, and profit of HFSs.

Keywords: Power-hydrogen coupled integrated energy system; Volt-VAR control; Safe deep reinforcement learning; Hydrogen fueling station (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261924015538
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:375:y:2024:i:c:s0306261924015538

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2024.124170

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().