A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience
Chunchun Jia,
Hongwen He,
Jiaming Zhou,
Jianwei Li,
Zhongbao Wei and
Kunang Li
Energy, 2023, vol. 282, issue C
Abstract:
Data-driven intelligent energy management strategy (EMS) helps to further improve the performance and efficiency of fuel cell hybrid electric bus (FCHEB). However, most deep reinforcement learning (DRL) algorithms suffer from disadvantages such as overestimation and poor training stability, which limit the optimization effectiveness of the strategy. In addition, DRL-based EMSs tend to achieve good control only for the set optimization objectives and cannot be generalized to optimization objectives beyond the reward function. To solve the above problems, a novel health-aware DRL energy management for FCHEB is proposed in this paper. Firstly, based on the actual collected city bus driving cycles, a large amount of high-quality learning experience containing health-aware information is obtained through an advanced model predictive control strategy. Secondly, the state-of-the-art Twin Delayed Deep Deterministic policy gradient (TD3) algorithm is combined with offline high-quality learning experience to address the inherent shortcomings during the “cold-start phase” and to enhance the generalization capability of the proposed strategy. Finally, validation results showed that the proposed EMS improves training efficiency by 61.85% and fuel economy by 7.45%, extends fuel cell life by 4% and battery life by 19.4% compared to the conventional TD3-based EMS.
Keywords: Fuel cell buses; Energy management strategy; Deep reinforcement learning; High-quality learning experience; Vehicular energy systems durability (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (3)
Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223023228
Full text for ScienceDirect subscribers only
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:282:y:2023:i:c:s0360544223023228
DOI: 10.1016/j.energy.2023.128928
Access Statistics for this article
Energy is currently edited by Henrik Lund and Mark J. Kaiser
More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu (repec@elsevier.com).