Adaptive hybrid car following strategy using cooperative adaptive cruise control and deep reinforcement learning

Yuqi Zheng, Ruidong Yan, Bin Jia, Rui Jiang, Adriana Tapus, Xiaojing Chen, Shiteng Zheng and Ying Shang

Physica A: Statistical Mechanics and its Applications, 2025, vol. 672, issue C

Abstract: The hybrid strategy can fully utilize the exploration ability of reinforcement learning while using rule-based strategies to ensure a lower performance limitation. The key challenge in this strategy is determining the optimal point for rule-based intervention within the learning-based framework,where a fixed empirical coefficient is usually applied to guide this intervention. However, the fixed coefficient is less effective in adapting to complex traffic conditions, particularly in mixed traffic flows, and significantly limits the overall performance. To overcome this, an adaptive hybrid car following strategy is proposed. Different from the fixed coefficient based strategy, two adaptive coefficients are calculated at each timestep. One adaptive coefficient is calculated iteratively using a Kalman Filter over multi-timestamp predictions, and another one is calculated through Monte Carlo Tree Search algorithm. These adaptive coefficients dynamically decide the optimal point, thereby enhancing the system’s ability to handle complex scenarios such as mixed traffic flows. The effectiveness of the proposed algorithm has been validated through mathematical proof and extensive numerical simulations. Results from simulations, supported by both statistical analysis and specific case studies, demonstrate that, compared to the conventional method with a fixed coefficient, the proposed strategy significantly enhances safety, comfort, and efficiency in car following under complex traffic conditions.

Keywords: Autonomous driving; Car following; Deep reinforcement learning; Hybrid strategy (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437125003036
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:672:y:2025:i:c:s0378437125003036

DOI: 10.1016/j.physa.2025.130651

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().