Research on energy management strategy of heavy-duty fuel cell hybrid vehicles based on dueling-double-deep Q-network

Xiaokai Guo, Xianguo Yan, Zhi Chen and Zhiyu Meng

Energy, 2022, vol. 260, issue C

Abstract: Fuel cell hybrid vehicle (FCHV) is an effective way to improve emissions and fuel economy. Energy management strategy (EMS), as a core assignment of FCHV, its most significant challenge is to achieve a sensible trade-off between system degradation and hydrogen consumption with less computational cost under diverse environments. Although most strategies can employ finite-density discretization to approach the optimum solutions, it brings poor performance. Herein, an advanced dueling-double-deep Q-network (D3QN) EMS based on a deep reinforcement learning framework is developed to solve the challenges, which can process higher-dimensional space and output dominant actions for an agent to obtain higher cumulative rewards. By adopting a dueling neural network, a better policy is acquired via generalizing learning across actions in the presence of similar value-actions. Moreover, an evaluation mechanism of Allowable Approach Punishment is introduced into rewards to mitigate system degradation. Simulation experiments reveal the prominence of the D3QN algorithm. Results demonstrate D3QN achieves less hydrogen consumption and retards fuel cell degradation on the premise of meeting power balance. Furthermore, adaptability and robustness are verified. Outcomes show D3QN can not only adapt to complex surroundings but also overcome noise and instability. Finally, real-time applicability is validated via the HIL test-bench.

Keywords: Energy management strategy; Fuel cell hybrid heavy-duty truck; Deep reinforcement learning; Dueling-double-deep Q-network; Self-learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544222019909
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:260:y:2022:i:c:s0360544222019909

DOI: 10.1016/j.energy.2022.125095

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().