Integrating reinforcement-learning-based vehicle dispatch algorithm into agent-based modeling of autonomous taxis

Zequn Li, Mustafa Lokhandwala, Abubakr O. Al-Abbasi, Vaneet Aggarwal and Hua Cai ()
Additional contact information
Zequn Li: Purdue University
Mustafa Lokhandwala: Purdue University
Abubakr O. Al-Abbasi: Purdue University
Vaneet Aggarwal: Purdue University
Hua Cai: Purdue University

Transportation, 2025, vol. 52, issue 2, No 9, 667 pages

Abstract: Abstract While increasing number of studies are using agent-based models to study the potential environmental, economic, and social impacts of shared autonomous vehicles, the idle vehicle dispatching in these models is often simplified to heuristic rules. Because the system performance of an autonomous taxi fleet can be significantly affected by the vehicle dispatching algorithm, refining the vehicle dispatching can help us better evaluate the potential benefits and impacts of shared autonomous vehicle systems. The recent development of reinforcement-learning-based vehicle dispatching algorithms provides opportunities to improve autonomous vehicle system modeling with efficient and scalable vehicle dispatching. This study integrates a reinforcement learning algorithm into to an agent-based simulation model of a ride hailing system. Using an autonomous taxi fleet in New York City as a case study, we compared the system performance of using the proposed Deep Q-Network (DQN) method for dispatching decision with common rule-based and heuristic dispatch algorithms from relevant literatures. The results show that (1) DQN dispatches vehicles more conservatively (with less dispatching activities and distances) but achieved similar (slightly lower) rider service level with proactive dispatch methods; and (2) DQN outperformed all other dispatch methods evaluated in this study with significantly higher dispatch efficiency, as measured by the ratio of the number of extra riders served due to dispatching to the extra fleet dispatch distance.

Keywords: Autonomous vehicles; Agent-based modeling; Reinforcement learning; Ride hailing; Vehicle dispatching efficiency (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11116-023-10433-w Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:transp:v:52:y:2025:i:2:d:10.1007_s11116-023-10433-w

Ordering information: This journal article can be ordered from
http://www.springer. ... ce/journal/11116/PS2

DOI: 10.1007/s11116-023-10433-w

Access Statistics for this article

Transportation is currently edited by Kay W. Axhausen

More articles in Transportation from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().