Safe off-policy reinforcement learning on eco-driving for a P2-P3 hybrid electric truck

Zhong Wang, Yahui Zhao, Yahui Zhang, Yang Tian and Xiaohong Jiao

Energy, 2024, vol. 313, issue C

Abstract: With the rapid development of intelligent transportation system(ITS) and network technology, vehicles can receive more information about traffic conditions. Although many researchers have conducted the research on eco-driving, many methods ignore the unsafety of reinforcement learning agent or use complex mechanism to improve behavior or they set simple reward function to express the relationship between the SOC and fuel consumption. This paper proposes a safe-off policy eco-driving strategy(SOPEDS) based on a hierarchical frame for a hybrid electric truck in a truck-following scenario in order to solve the problems. Firstly, the truck-following strategy in the upper layer is designed based on the deep deterministic policy gradient(DDPG) algorithm. Then the relevant safe mechanism is introduced in order to reduce the collision risk. In the lower layer, the energy management strategy designed by using reinforcement learning(RL) algorithm. And a new function is designed to shape the reward function to guide agent learning. Finally, the performance of the proposed method is proved by experiments. The results show the fuel saving rate can reach 97.46% of the DP. Our research improved driving safety and introduced a reward function design method which is meaningful for RL training processing for other vehicles.

Keywords: SOPEDS; Hybrid electric truck; Safe mechanism; Shape the reward function (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224036624
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:313:y:2024:i:c:s0360544224036624

DOI: 10.1016/j.energy.2024.133884

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().