Longitudinal control of connected and automated vehicles among signalized intersections in mixed traffic flow with deep reinforcement learning approach

Chunyu Liu, Zihao Sheng, Sikai Chen, Haotian Shi and Bin Ran

Physica A: Statistical Mechanics and its Applications, 2023, vol. 629, issue C

Abstract: Trajectory optimization for connected automated vehicles (CAVs) is an effective method to improve the overall performance of urban traffic. At the same time, the emergence of deep reinforcement learning (DRL) enables agents to learn the optimal strategy in a complex environment by constantly interacting with the environment. In a connected environment with signalized intersections, the optimal control of CAV can significantly reduce fuel consumption and improve driving comfort under the premise of ensuring both traffic efficiency and travel safety. Thus, a DRL-based longitudinal trajectory control approach is proposed to optimize the motion of the CAV in a mixed traffic flow with signalized intersections. By designing a reasonable reward function comprising fuel consumption reward, safety reward, traffic light reward, and travel time reward, the CAV can learn the optimal policy and reach the destination adhering to traffic light and safety. Moreover, the potential-based reward is carefully designed to provide prior knowledge for agents. Eventually, the performances of the CAV with the proposed strategy are testified under different scenarios. Simulation results show that our proposed DRL-based optimization method can effectively save fuel consumption of the CAV and the whole platoon, as well as improve driving comfort in all scenarios while satisfying the rules of traffic lights and travel safety.

Keywords: Connected automated vehicles; Deep reinforcement learning; Mixed traffic stream; Signalized intersection; Trajectory optimization (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437123007446
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:629:y:2023:i:c:s0378437123007446

DOI: 10.1016/j.physa.2023.129189

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().