Learning eco-driving strategies from human driving trajectories

Xiaoyu Shi, Jian Zhang, Xia Jiang, Juan Chen, Wei Hao and Bo Wang

Physica A: Statistical Mechanics and its Applications, 2024, vol. 633, issue C

Abstract: Eco-driving represents a promising avenue for mitigating energy consumption in road transportation. To enhance the applicability of learning-based eco-driving strategies, this study presents a novel framework that employs offline reinforcement learning in eco-driving control. This framework enables a vehicle agent to acquire eco-driving behavior by leveraging real-world human driving trajectories. Specifically, the human driving trajectories, along with the corresponding traffic signal timing scheme, obtained from empirical data, are utilized to construct a comprehensive Markov Decision Process (MDP) dataset for offline policy training. To accommodate learning from sub-optimal human-driving data, a Conservative Q-learning (CQL) algorithm is deployed. Subsequently, the proposed offline learning method is compared with alternative learning-based, model-based, and rule-based approaches, effectively illustrating the feasibility of offline learning and the efficacy of the CQL algorithm. Notably, the energy consumption is demonstrated to be improved by 67.3% compared to a behavioral car-following model, with only marginal compromise to travel efficiency. Furthermore, a sensitivity analysis is conducted, revealing the generalizability of the offline learning-based method across various simulation configurations and even diverse energy consumption models.

Keywords: Eco-driving; Offline reinforcement learning; Conservative Q-learning; Signal phase and timing (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437123009081
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:633:y:2024:i:c:s0378437123009081

DOI: 10.1016/j.physa.2023.129353

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().