Towards sustainable and intelligent urban transportation: A novel deep transfer reinforcement learning framework for eco-driving of fuel cell buses

Ruchen Huang, Hongwen He, Qicong Su and Jingda Wu

Energy, 2025, vol. 330, issue C

Abstract: Eco-driving is a sustainable technology that optimizes both energy management and speed planning for electrified vehicles. Particularly when combined with emerging deep reinforcement learning (DRL) techniques, eco-driving strategies (EDSs) can be more intelligent. However, current research on eco-driving, namely the holistic solution, lags behind the advancements in its sub-problem namely energy management, and the development of DRL-based EDSs remains time-consuming. Since energy management is a sub-task of eco-driving, it offers a potential way to rapidly develop EDSs by reusing pre-trained energy management strategies (EMSs). Based on this, this paper proposes an expedited method for developing soft actor-critic (SAC) based EDSs for fuel cell buses (FCBs) in the vehicle-following scenario. To ensure that SAC-based EMSs can be effectively transferred to EDSs, an innovative heterogeneous deep transfer reinforcement learning framework is designed. Within this framework, all the knowledge learned in the source EMS can be transferred and reused by the target EDS. More importantly, the transferability of heterogeneous deep neural networks and heterogeneous experience replay buffers is particularly verified. Simulation results show that the proposed framework provides a 71.01 % acceleration in convergence speed and a 7.30 % improvement in fuel economy. This article contributes to correlating different optimization tasks of FCBs through advanced artificial intelligence technologies.

Keywords: Fuel cell bus; Energy management; Eco-driving; Deep transfer reinforcement learning; Soft actor-critic (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544225023722
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:330:y:2025:i:c:s0360544225023722

DOI: 10.1016/j.energy.2025.136730

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().