Intelligent Ramp Control for Incident Response Using Dyna- Architecture

Chao Lu, Yanan Zhao and Jianwei Gong

Mathematical Problems in Engineering, 2015, vol. 2015, 1-16

Abstract:

Reinforcement learning (RL) has shown great potential for motorway ramp control, especially under the congestion caused by incidents. However, existing applications limited to single-agent tasks and based on -learning have inherent drawbacks for dealing with coordinated ramp control problems. For solving these problems, a Dyna- based multiagent reinforcement learning (MARL) system named Dyna-MARL has been developed in this paper. Dyna- is an extension of -learning, which combines model-free and model-based methods to obtain benefits from both sides. The performance of Dyna-MARL is tested in a simulated motorway segment in the UK with the real traffic data collected from AM peak hours. The test results compared with Isolated RL and noncontrolled situations show that Dyna-MARL can achieve a superior performance on improving the traffic operation with respect to increasing total throughput, reducing total travel time and CO 2 emission. Moreover, with a suitable coordination strategy, Dyna-MARL can maintain a highly equitable motorway system by balancing the travel time of road users from different on-ramps.

Date: 2015
References: Add references at CitEc
Citations:

Downloads: (external link)
http://downloads.hindawi.com/journals/MPE/2015/896943.pdf (application/pdf)
http://downloads.hindawi.com/journals/MPE/2015/896943.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnlmpe:896943

DOI: 10.1155/2015/896943

Access Statistics for this article

More articles in Mathematical Problems in Engineering from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().