Deep reinforcement learning-based multi-lane mixed traffic ramp merging strategy

Tong Zhou, Yuzhao Huang, Yudan Tian, Hua Huang, Minghui Ou and Tao Lin

PLOS ONE, 2025, vol. 20, issue 9, 1-19

Abstract: Due to concentrated conflicts, on-ramp merging is an important scenario in the study of new hybrid traffic control. Current research mainly focuses on optimizing the vehicle passage sequence of ramp vehicles merging with mainline vehicles in single-lane scenarios, neglecting the coordination problem of vehicles in multiple mainline lanes. Therefore, an Improved Dueling Double DQN (D3QN) On-ramp Merging Strategy (IDS stands for the initials of Improved, D3QN, and Strategy) combined with a sine function is proposed, establishing a Vehicle Coordination System (VCS) to guide the merging of vehicles in multi-lane mainline traffic. This strategy uses the improved D3QN algorithm combined with the excellent smoothness of the sine function to evaluate driving safety, helping vehicles find suitable gaps in traffic flow. An action masking mechanism was deployed during the strategy exploration phase to prevent unsafe actions. The proposed VCS + IDS strategy was tested in SUMO simulations of on-ramp merging under different density of vehicle flow. Under a traffic flow of 1200 vehicles per lane per hour, the on-ramp merging completion rate of VCS + IDS reached 98.62%, and the task completion rate was 98.11%, which increased by 11.08% and 10.79% compared to traditional D3QN, respectively, validating the effectiveness of this method.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0331986 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 31986&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0331986

DOI: 10.1371/journal.pone.0331986

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().