Towards adaptive deep reinforcement learning energy management for electric vehicles: An online updating approach

Kaifu Guan, Zhiwu Huang, Yang Gao, Yue Wu, Fei Li and Heng Li

Energy, 2025, vol. 325, issue C

Abstract: Deep reinforcement learning is a potential method for online energy management of electric vehicles. However, deep reinforcement learning can suffer from limited training data and underfitting/overfitting characteristics, leading to a compromised vehicle economy in online applications. This paper proposes an online updating approach for deep reinforcement learning-based energy management in electric vehicles with battery/supercapacitor hybrid energy management systems. Firstly, Jensen–Shannon Divergence is introduced to compare the pre-training and online velocity transfer probability surfaces quantitatively and to trigger the online strategy updating when exceeding the threshold. Secondly, existing online driving data is optimized through dynamic programming to construct the optimal state/action dataset, which will be used for actor-network updating. Thirdly, a soft updating method is further proposed to ensure smooth strategy updating for satisfactory generalization ability based on the weighted fusion of multiple networks. Results under Dallas real-world driving cycles validate that the proposed online updating method can reduce the battery degradation and vehicle operation cost by 5.3-10.2% and 4.5-9.0%, respectively, compared with the strategy before updating. This study provides a meaningful attempt at the online updating of deep reinforcement learning-based energy management strategies, which can be easily extended to different vehicle types and driving conditions.

Keywords: Energy management; Hybrid energy storage system; Deep reinforcement learning; Battery durability; Online updating; Jensen–Shannon divergence (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S036054422501638X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:325:y:2025:i:c:s036054422501638x

DOI: 10.1016/j.energy.2025.135996

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().