A Comparative Study of Energy Management Strategies for Battery-Ultracapacitor Electric Vehicles Based on Different Deep Reinforcement Learning Methods

Wenna Xu, Hao Huang (), Chun Wang, Shuai Xia and Xinmei Gao
Additional contact information
Wenna Xu: School of Mechanical Engineering, Sichuan University of Science and Engineering, Yibin 644000, China
Hao Huang: School of Mechanical Engineering, Sichuan University of Science and Engineering, Yibin 644000, China
Chun Wang: School of Mechanical Engineering, Sichuan University of Science and Engineering, Yibin 644000, China
Shuai Xia: School of Mechanical Engineering, Sichuan University of Science and Engineering, Yibin 644000, China
Xinmei Gao: School of Mechanical Engineering, Sichuan University of Science and Engineering, Yibin 644000, China

Energies, 2025, vol. 18, issue 5, 1-18

Abstract: An efficient energy management strategy (EMS) is crucial for the energy-saving and emission-reduction effects of electric vehicles. Research on deep reinforcement learning (DRL)-driven energy management systems (EMSs) has made significant strides in the global automotive industry. However, most scholars study only the impact of a single DRL algorithm on EMS performance, ignoring the potential improvement in optimization objectives that different DRL algorithms can offer under the same benchmark. This paper focuses on the control strategy of hybrid energy storage systems (HESSs) comprising lithium-ion batteries and ultracapacitors. Firstly, an equivalent model of the HESS is established based on dynamic experiments. Secondly, a regulated decision-making framework is constructed by uniformly setting the action space, state space, reward function, and hyperparameters of the agent for different DRL algorithms. To compare the control performances of the HESS under various EMSs, the regulation properties are analyzed with the standard driving cycle condition. Finally, the simulation results indicate that the EMS powered by a deep Q network (DQN) markedly diminishes the detrimental impact of peak current on the battery. Furthermore, the EMS based on a deep deterministic policy gradient (DDPG) reduces energy loss by 28.3%, and the economic efficiency of the EMS based on dynamic programming (DP) is improved to 0.7%.

Keywords: hybrid energy storage system; energy management strategy; deep reinforcement learning; energy loss (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/18/5/1280/pdf (application/pdf)
https://www.mdpi.com/1996-1073/18/5/1280/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:18:y:2025:i:5:p:1280-:d:1606027

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().