Solving traffic queues at controlled-signalized intersections in continuous-time Markov games

Rodrigo Castillo González, Julio B. Clempner and Alexander S. Poznyak

Mathematics and Computers in Simulation (MATCOM), 2019, vol. 166, issue C, 283-297

Abstract: The traffic signal control plays a fundamental role to improve the efficiency and efficacy of traffic flows in traffic networks. This paper is the first work in which we consider a mathematically rigorous study of the continuous-time, discrete state, multi-traffic signal control problem using a non-cooperative game theory approach. The solution of the problem is circumscribed to an ergodic, controllable, discrete state, continuous-time Markov game computed under the expected average cost criterion. This paper provides several main contributions. First, we present a general continuous-time queue model, which is employed as the fundamental scheme of a computationally tractable game theory approach for the signal control continuous-time Markov game. This model is transformed into a discrete state Poisson process where the vehicles leave the queue in the order they arrive. Second, in this problem, each signal controller (player) aims at finding green time that minimizes its signal and queuing delay. Then, a conflict appears when each signal controller tries to minimize its queue. We study the problem of computing a Nash equilibrium for this game. Our third contribution employs a proximal/gradient method for computing the Nash equilibrium point of the game. By introducing new restrictions over the signal controller and adding a restriction for continuous-time Markov chains, we obtain the set of average optimal policies, which is one of the main results of this paper. Hence, our final contribution shows, in simulation, the usefulness of the proposed method with an application example.

Keywords: Traffic signal; Continuous-time Markov chains; Average optimality criterion; Nash equilibrium (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378475419302009
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:166:y:2019:i:c:p:283-297

DOI: 10.1016/j.matcom.2019.06.002

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().