Global optimization guided energy management strategy for hybrid electric vehicles based on generative adversarial network embedded reinforcement learning

Yi Fan, Jiankun Peng, Sichen Yu, Fang Yan, Zexing Wang, Menglin Li and Mei Yan

Energy, 2025, vol. 322, issue C

Abstract: The learning-based energy management strategy (EMS) for hybrid electric vehicles (HEVs) are predominantly driven by deep reinforcement learning (DRL). However, DRL requires substantial time and computational resources for aimless trial and error, despite its application in problems like EMS that can yield global optimal solutions. This paper draws on the framework of Generative Adversarial Imitation Learning (GAIL), utilizing a discriminator network as a conduit for the EMS transitioning from Proximal Policy Optimization (PPO) to the demonstrations based on Dynamic Programming (DP), thereby enhancing the training efficiency and optimality. Initially, expert state-action data is extracted from the offline DP solution. Subsequently, an online PPO state-action generator for EMS is constructed, which trains the discriminator alongside the expert data. The discriminator identifies all policies that deviate from the demonstrations, while PPO generator aims at deceiving the discriminator, thus fostering a mutually beneficial adversarial relationship. Simulation results indicate that the proposed method shortens training time by 68.4 % compared to the original PPO, achieving fuel economy exceeding 95 % under varying initial state of charge (SoC) of the power battery.

Keywords: Hybrid electric vehicle; Energy management strategy; Deep reinforcement learning; Imitation learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225012289
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:322:y:2025:i:c:s0360544225012289

DOI: 10.1016/j.energy.2025.135586

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().