Coupled vehicle-signal control based on Stackelberg Game Enabled Multi-agent Reinforcement Learning in mixed traffic environment

Xinshao Zhang, Zhaocheng He, Yiting Zhu and Wei Huang

Physica A: Statistical Mechanics and its Applications, 2025, vol. 658, issue C

Abstract: Related studies on traffic control in partially connected environments either did not consider the collaboration of traffic signal control and vehicular control, or did not consider others’ responsive actions before decision-making in coupled vehicle-signal control. Thus, we propose a Stackelberg Game Enabled Multi-agent Reinforcement Learning (SGMRL) method for coupled vehicle-signal control at an intersection with mixed traffic flow of Connected and Automated Vehicles (CAVs)/Human Driven Vehicles (HDVs). A two-stage framework is applied in SGMRL to learn optimal signal control strategy and CAV platoon strategies in mixed flows of all entrance roads at an intersection. Stackelberg game theory is introduced in SGMRL to make an asynchronous decision-making mechanism. The signal controller is a leader that allocates green times to different phases based on predictions of vehicles’ responsive actions, and CAVs in different directions are followers that form platoons and adjust speeds to adapt to the signal lights decided by the leader. Moreover, CAV platoons in different directions are regarded as agents and form a multi-agent learning framework with the signal controller. Then, an improved Dueling Double Deep Q Network (ID3QN) algorithm is investigated to calculate the Stackelberg equilibrium for the control problem. Experimental results demonstrate that the proposed model effectively reduces the overall waiting time and queue length of all vehicles, in the mixed traffic environment with different CAV penetration rates.

Keywords: Signal optimization; Trajectory planning; Mixed traffic environment; Platoon control (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437124007994
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:658:y:2025:i:c:s0378437124007994

DOI: 10.1016/j.physa.2024.130289

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().