EconPapers    
Economics at your fingertips  
 

A novel health-aware deep reinforcement learning energy management for fuel cell bus incorporating offline high-quality experience

Chunchun Jia, Hongwen He, Jiaming Zhou, Jianwei Li, Zhongbao Wei and Kunang Li

Energy, 2023, vol. 282, issue C

Abstract: Data-driven intelligent energy management strategy (EMS) helps to further improve the performance and efficiency of fuel cell hybrid electric bus (FCHEB). However, most deep reinforcement learning (DRL) algorithms suffer from disadvantages such as overestimation and poor training stability, which limit the optimization effectiveness of the strategy. In addition, DRL-based EMSs tend to achieve good control only for the set optimization objectives and cannot be generalized to optimization objectives beyond the reward function. To solve the above problems, a novel health-aware DRL energy management for FCHEB is proposed in this paper. Firstly, based on the actual collected city bus driving cycles, a large amount of high-quality learning experience containing health-aware information is obtained through an advanced model predictive control strategy. Secondly, the state-of-the-art Twin Delayed Deep Deterministic policy gradient (TD3) algorithm is combined with offline high-quality learning experience to address the inherent shortcomings during the “cold-start phase” and to enhance the generalization capability of the proposed strategy. Finally, validation results showed that the proposed EMS improves training efficiency by 61.85% and fuel economy by 7.45%, extends fuel cell life by 4% and battery life by 19.4% compared to the conventional TD3-based EMS.

Keywords: Fuel cell buses; Energy management strategy; Deep reinforcement learning; High-quality learning experience; Vehicular energy systems durability (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223023228
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:282:y:2023:i:c:s0360544223023228

DOI: 10.1016/j.energy.2023.128928

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu (repec@elsevier.com).

 
Page updated 2024-12-28
Handle: RePEc:eee:energy:v:282:y:2023:i:c:s0360544223023228