Research on Ecological Driving Following Strategy Based on Deep Reinforcement Learning

Weiqi Zhou (), Nanchi Wu, Qingchao Liu, Chaofeng Pan and Long Chen
Additional contact information
Weiqi Zhou: Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China
Nanchi Wu: Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China
Qingchao Liu: Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China
Chaofeng Pan: Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China
Long Chen: Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, China

Sustainability, 2023, vol. 15, issue 18, 1-14

Abstract: Traditional car-following models usually prioritize minimizing inter-vehicle distance error when tracking the preceding vehicle, often neglecting crucial factors like driving economy and passenger ride comfort. To address this limitation, this paper integrates the concept of eco-driving and formulates a multi-objective function that encompasses economy, comfort, and safety. A novel eco-driving car-following strategy based on the deep deterministic policy gradient (DDPG) is proposed, employing the vehicle’s state, including data from the preceding vehicle and the ego vehicle, as the state space, and the desired time headway from the intelligent driver model (IDM) as the action space. The DDPG agent is trained to dynamically adjust the following vehicle’s speed in real-time, striking a balance between driving economy, comfort, and safety. The results reveal that the proposed DDPG-based IDM model significantly enhances comfort, safety, and economy when compared to the fixed-time headway IDM model, achieving an economy improvement of 2.66% along with enhanced comfort. Moreover, the proposed approach maintains a relatively stable following distance under medium-speed conditions, ensuring driving safety. Additionally, the comprehensive performance of the proposed method is analyzed under three typical scenarios, confirming its generalization capability. The DDPG-enhanced IDM car-following model aligns with eco-driving principles, offering novel insights for advancing IDM-based car-following models.

Keywords: car following; DDPG algorithm; intelligent driver model; eco-driving; desired time headway (search for similar items in EconPapers)
JEL-codes: O13 Q Q0 Q2 Q3 Q5 Q56 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2071-1050/15/18/13325/pdf (application/pdf)
https://www.mdpi.com/2071-1050/15/18/13325/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jsusta:v:15:y:2023:i:18:p:13325-:d:1233575

Access Statistics for this article

Sustainability is currently edited by Ms. Alexandra Wu

More articles in Sustainability from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().