Real-time adaptive energy management for off-road hybrid electric vehicles based on decision-time planning

Ningkang Yang, Lijin Han, Lin Bo, Baoshuai Liu, Xiuqi Chen, Hui Liu and Changle Xiang

Energy, 2023, vol. 282, issue C

Abstract: Unknown and changeable driving conditions of off-road hybrid electric vehicle (HEV) challenge its energy management strategy (EMS). To tackle this issue, the paper develops a real-time adaptive strategy for off-road HEVs through decision-time planning (DTP), which is a unique method of model-based reinforcement learning (MBRL). First, the MBRL framework for the energy management problem is established, including a RL-oriented model and the DTP algorithm. The RL model consists of a deterministic nonlinear state space model and a stochastic recursive Markov Chain (MC), and the latter is constructed online and updated constantly according to new observations, which can reflect the driving condition precisely. Then, the DTP algorithm is detailed and applied. Instead of learning an overall policy for an entire driving cycle, it seeks to learn the optimal action for each encountered vehicle state, which improves the learning efficiency and realizes the real-time adaptive EMS. In the simulation, assuming that no prior information of the driving conditions is known, the proposed EMS only takes about 1–3% more fuel and 10% more battery life than dynamic programming in both off-road driving conditions and standard road cycles. The EMS significantly outperforms traditional Q-learning and rule-based strategy, verifying its optimization capability and adaptability.

Keywords: Off-road hybrid electric vehicle; Real-time adaptive energy management; Model-based reinforcement learning; Decision-time planning (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223022260
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:282:y:2023:i:c:s0360544223022260

DOI: 10.1016/j.energy.2023.128832

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().