An improved energy management strategy of fuel cell hybrid vehicles based on proximal policy optimization algorithm

Baomin Li, Yunduan Cui, Yao Xiao, Shengxiang Fu, Jongwoo Choi and Chunhua Zheng

Energy, 2025, vol. 317, issue C

Abstract: In this research, a novel deep reinforcement learning (DRL) algorithm, i.e. the proximal policy optimization (PPO) is applied to the energy management strategy (EMS) of a fuel cell hybrid vehicle (FCHV) with the dynamic programming (DP) knowledge and parallel computing. The proposed EMS is compared to other EMSs based on typical DRL algorithms including the deep Q-network (DQN) and twin delayed deep deterministic policy gradient (TD3) in terms of the algorithm convergence, FCHV fuel economy, and fuel cell durability. As a typical global optimization method, the DP-based EMS is also introduced as the fuel economy comparison benchmark. Furthermore, the proposed EMS is implemented on the dSPACE platform to verify the deployment feasibility on embedded devices. Results indicate that the hydrogen consumption difference of the PPO-based, DQN-based, and TD3-based EMSs to the DP-based EMS is 3.79 %, 8.45 %, 6.86 % and 1.47 %, 6.34 %, 5.73 % under the training and validation conditions respectively. Besides, compared to the DQN-based and TD3-based EMSs, the PPO-based EMS reduces the fuel cell degradation by 2.51 %, 0.12 % and 5.22 %, 3.27 % under the training and validation conditions respectively. Additionally, the convergence speed of the PPO-based EMS is faster than that of the DQN-based and TD3-based EMSs by 93.55 % and 97.17 %, respectively.

Keywords: Fuel cell hybrid vehicle; Energy management strategy; Deep reinforcement learning; Proximal policy optimization; Fuel cell degradation; dSPACE deployment (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225002270
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:317:y:2025:i:c:s0360544225002270

DOI: 10.1016/j.energy.2025.134585

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().