Interceptor agents in traffic flow: A reinforcement learning approach

Nikita V. Bykov, Maxim A. Kostrov and Mikhail S. Tovarnov

Chaos, Solitons & Fractals, 2025, vol. 200, issue P1

Abstract: This paper presents a simulation-based study of autonomous vehicle agents trained via reinforcement learning to intercept a moving target in a multi-lane traffic flow. The traffic environment is modeled using a stochastic cellular automaton based on the revised S-NFS model, and interceptor agents are implemented as neural networks trained with the APPO (Advantage-Weighted Proximal Policy Optimization) algorithm. Two types of reinforcement learning policies are considered: a single-agent strategy and a cooperative multi-agent strategy involving two interceptors. The interception process is divided into two phases: (i) convergence — reaching the target in dense traffic, and (ii) stopping — reducing the target’s speed through coordinated behavior. The performance of RL-based agents is evaluated against several heuristic baselines across a wide range of traffic densities. Key metrics include convergence time, average speed, lane-changing frequency, and impact on local traffic flow and density. Results indicate that RL-trained interceptors achieve faster convergence and more adaptive behavior compared to heuristic strategies. Moreover, while a single agent is generally insufficient to fully stop the target, coordinated multi-agent policies reliably achieve immobilization. The findings highlight the potential of reinforcement learning for real-time multi-agent decision-making in dynamic traffic environments.

Keywords: Traffic; Reinforcement learning; Cellular automata; Interception strategy; Lane-changing behavior (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925010173
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:200:y:2025:i:p1:s0960077925010173

DOI: 10.1016/j.chaos.2025.117004

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().