Energy efficient speed planning of electric vehicles for car-following scenario using model-based reinforcement learning

Heeyun Lee, Kyunghyun Kim, Namwook Kim and Suk Won Cha

Applied Energy, 2022, vol. 313, issue C, No S0306261921016858

Abstract: Eco-driving is a term used to refer to a strategy for operating vehicles so as to minimize energy consumption. Without any hardware changes, eco-driving is an effective approach to improving vehicle efficiency by optimizing driving behavior, particularly for autonomous vehicles. Several approaches have been proposed for eco-driving, such as dynamic programming, Pontryagin’s minimum principle, and model predictive control; however, it is difficult to control the speed of the vehicle optimally in various driving situations. This study aims to derive an eco-driving strategy for reducing the energy consumption of a vehicle in diverse driving situations, including road slopes and car-following scenarios. A reinforcement learning-based energy efficient speed planning strategy is proposed for autonomous electric vehicles, which learn an optimal control policy through a data-driven learning process. A model-based reinforcement learning algorithm is developed for the eco-driving strategy; based on domain knowledge of the vehicle powertrain, a battery energy consumption model and longitudinal dynamics model of the vehicle are approximated from the driving data and are used for reinforcement learning. The proposed algorithm is tested using a vehicle simulation, and is compared to a global optimal solution obtained using an exact dynamic programming method. The simulation results show that the reinforcement learning algorithm can adjust the speed of the vehicle by considering driving conditions such as the road slope and a safe distance from the leading vehicle while minimizing energy consumption. The reinforcement learning algorithm achieves a near-optimal performance of 93.8% relative to the dynamic programming result.

Keywords: Eco-driving; Electric vehicle; Optimal control; Reinforcement learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (13)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261921016858
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:313:y:2022:i:c:s0306261921016858

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2021.118460

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().