A two-level collaborative multi-agent reinforcement learning framework for variable speed limit control of freeway tunnel groups

Jieling Jin, Hui Zhang, Lu Xing, Helai Huang and Yansheng Chen

Transportation Research Part A: Policy and Practice, 2026, vol. 211, issue C

Abstract: Compared to freeway mainline sections, freeway tunnels present a higher risk of collisions and pose greater challenges for rescue operations, owing to the distinctive features of tunnel lighting and structures. Moreover, the safety demands for tunnel groups, which consist of multiple tunnels, are more pronounced. Recent studies have demonstrated the promising application of reinforcement learning in implementing variable speed limit (VSL) control on freeways to enhance safety and efficiency. However, existing approaches cannot adequately capture the interaction of traffic flows across different tunnels in group scenarios, nor can they efficiently train policies under highly complex environments. This study proposes a VSL strategy based on a two-level collaborative multi-agent reinforcement learning (TCMARL) framework to improve the safety and efficiency of freeway tunnel groups. The framework realizes coordinated control at two levels: (1) capturing potential spatial dependencies among tunnel agents through a spatial graph model, thereby achieving synergy at the information input level; and (2) constructing a mixing network that fuses features of different tunnel agents and introducing an importance weight vector to optimize the global Q-value output, achieving synergy at the action output level. To improve training efficiency and policy generalization, a model-based reinforcement learning mechanism is further incorporated to generate short-horizon virtual rollouts. Simulation experiments are conducted in four tunnel-group scenarios, including two-, three-, four-, and five-tunnel configurations. Comparative results show that the proposed framework achieves faster convergence and better safety and efficiency performance than benchmark methods. Additional ablation and sensitivity analyses confirm the complementary roles of the two-level collaboration design and the model-based planning mechanism, while out-of-training testing under unseen demand profiles demonstrates robust transferability. Beyond algorithmic performance, the findings provide policy relevant evidence for corridor level speed management in smart freeway tunnel systems, informing practical guidelines on coordinated VSL deployment and operational governance.

Keywords: Freeway tunnel groups; Variable speed limit; Multi-agent reinforcement learning; Two-level collaboration; Spatial graph model; Importance weight (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0965856426002326
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:transa:v:211:y:2026:i:c:s0965856426002326

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.tra.2026.105091

Access Statistics for this article

Transportation Research Part A: Policy and Practice is currently edited by John (J.M.) Rose

More articles in Transportation Research Part A: Policy and Practice from Elsevier
Bibliographic data for series maintained by Catherine Liu ().