Partially observable Markov decision process for perimeter control based on a stochastic macroscopic fundamental diagram

HongSheng Qi

Physica A: Statistical Mechanics and its Applications, 2024, vol. 634, issue C

Abstract: The use of a macroscopic fundamental diagram (MFD) for perimeter control is an effective strategy for managing traffic flow on regional road networks. However, existing methods either assume a MFD with low scattering or assume complete availability of information, which is not realistic. In order to address these limitations, we propose a novel approach that incorporates a stochastic evolution dynamic into the MFD and introduces a partially observable Markov decision process for perimeter control. Our approach assumes that the MFD is randomly distributed between upper and lower boundaries, characterized by a physically interpretable parameter, and that real-time observations represent cumulative data in specific regions. We focus on three sub-objectives: minimizing travel time, minimizing capacity loss due to hysteresis, and preventing gridlock. By utilizing the Bellman equation, we solve the problem and demonstrate that our proposed control method enhances trip completion rates by 7.2% compared to the benchmark case without perimeter control. Furthermore, the inclusion of stochasticity leads to an additional 1.2% improvement in trip completion rates. Through extensive numerical tests, we establish the effectiveness of our approach in optimizing traffic flow regulation on regional road networks.

Keywords: Macroscopic fundamental diagram, stochastic differential equation; Partial observable Markov decision process; Bellman (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437123010361
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:634:y:2024:i:c:s0378437123010361

DOI: 10.1016/j.physa.2023.129481

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().