Hierarchical control for stochastic network traffic with reinforcement learning

Z.C. Su, Andy H.F. Chow, C.L. Fang, E.M. Liang and R.X. Zhong

Transportation Research Part B: Methodological, 2023, vol. 167, issue C, 196-216

Abstract: This study proposes a hierarchical control framework to maximize the throughput of a road network driven by travel demand with uncertainties. In the upper level, a perimeter controller regulates the traffic influx into the core road network. The upper level uses a reinforcement learning algorithm that learns and responds to the traffic dynamics in the core road network without the need for an underlying system model and macroscopic fundamental diagram. The lower level is a local signal control system that regulates the spatial distribution of traffic flow within the core network. The results show that the hierarchical control framework can improve road network throughput by coordinating control actions conducted at the two levels. The improvement in system-wide performance is validated by a range of performance metrics and macroscopic flow-accumulation patterns realized under different control settings. The study contributes to the management of urban road networks with advanced computing technologies.

Keywords: Stochastic network traffic; Macroscopic fundamental diagram; Perimeter control; Max-pressure; Reinforcement learning (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0191261522002028
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:transb:v:167:y:2023:i:c:p:196-216

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.trb.2022.12.001

Access Statistics for this article

Transportation Research Part B: Methodological is currently edited by Fred Mannering

More articles in Transportation Research Part B: Methodological from Elsevier
Bibliographic data for series maintained by Catherine Liu ().