Learning from common knowledge: A multi-agent cooperative ramp merging framework for decentralized autonomous vehicles

Ang Ji, Zhennan Ma, Hongtai Yang, Asad J. Khattak and David Levinson
Additional contact information
David Levinson: TransportLab, School of Civil Engineering, University of Sydney

Working Papers from University of Minnesota: Nexus Research Group

Abstract: This paper proposes a multi-agent reinforcement learning (MARL) framework that combines an offline shared pool of information (SPI) with hypernetworks to enable cooperative on-ramp merging among high-level autonomous vehicles (AVs), leveraging common knowledge for spontaneous cooperation. First, we discuss the construction method of the common knowledge base-SPI from two approaches: model- and data-driven methods. Then, we design an on-board fine-tuning algorithm that enables each agent to refine its policy from local observations without any communication protocols. Based on the above advances, we develop a hybrid SPI-based on-ramp merging strategy driven by the physical model and human driving data. Finally, the proposed framework is evaluated in simulated peak- and off-peak traffic scenarios calibrated by the Zen trajectory dataset. The results demonstrate improved traffic efficiency outcomes and fewer collision occurrences than several baselines under the evaluated conditions. The findings reveal possible research directions for future work and provide insights for the application of the decentralized-training-decentralized-execution framework in autonomous driving.

Keywords: Autonomous vehicles; Multi-agent reinforcement learning; Ramp merging; Shared information pool (search for similar items in EconPapers)
JEL-codes: R40 (search for similar items in EconPapers)
Date: 2026-10-12
New Economics Papers: this item is included in nep-tre
References: Add references at CitEc
Citations:

Published in Transportation Research Part E: Logistics and Transportation Review 105275

Downloads: (external link)
https://doi.org/10.1016/j.tre.2026.105275 Published version landing page, 2026 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nex:wpaper:paper-2026-23

DOI: 10.1016/j.tre.2026.105275

Access Statistics for this paper

More papers in Working Papers from University of Minnesota: Nexus Research Group Contact information at EDIRC.
Bibliographic data for series maintained by David Levinson ().