A knowledge-assisted deep reinforcement learning approach for energy management in hybrid electric vehicles

Aramchehr Zare and Mehrdad Boroushaki

Energy, 2024, vol. 313, issue C

Abstract: Achieving a robust Energy Management Strategy (EMS) for Hybrid Electric Vehicles (HEVs) requires meeting several control objectives, such as drivability, reducing fuel consumption, and maintaining the state of battery charge (SoC), making the EMS a critical component of HEVs. The current EMS relies on prior knowledge of the instantaneous optimal working points of the Internal Combustion Engine (ICE), which leads to suboptimal solutions in episodic driving cycles. Previous efforts to implement Reinforcement Learning (RL) encountered challenges such as slow convergence, instability in tracking driving cycles, and inadequate performance under real driving conditions. This paper presents an intelligent EMS based on a hybrid Knowledge-Assisted system that integrates a Deterministic Policy Gradient (KA-DDPG) and a Deep Q-Network (KA-DQN) to overcome the challenges of RL and achieve optimal EMS actions under various driving conditions. Two versions of the proposed algorithm—offline and online—are presented. Simulation results show that KA-DDPG requires less computation time, reduces fuel consumption by 6.99 %–7.26 % in offline mode and 5.18 %–5.67 % in online mode, and maintains SoC stability. These methods improve average negative electric motor torque and result in greater energy savings, while the robustness of the algorithm has been examined by changing the vehicle's weight.

Keywords: Hybrid electric vehicle; Energy management strategy; Deep reinforcement learning; Deep Q-Network; Deep deterministic policy gradient; Knowledge-assist (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S036054422403891X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:313:y:2024:i:c:s036054422403891x

DOI: 10.1016/j.energy.2024.134113

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().