Reinforcement learning-based real-time intelligent energy management for hybrid electric vehicles in a model predictive control framework

Ningkang Yang, Shumin Ruan, Lijin Han, Hui Liu, Lingxiong Guo and Changle Xiang

Energy, 2023, vol. 270, issue C

Abstract: —This paper proposes a real-time energy management strategy (EMS) for hybrid electric vehicles by incorporating reinforcement learning (RL) in a model predictive control (MPC) framework, which avoids the inherent drawbacks of RL—the excessive learning time and lack of adaptability—and remarkably enhances the real-time performance of MPC. First, the MPC framework for the energy management problem is formulated. In that, a novel long short-term memory (LSTM) neural network is utilized to construct the velocity predictor for a more accurate prediction, and its prediction capability is verified by a comparative analysis. Then, the HEV prediction model and the velocity predictor are regarded as the RL model with which the RL agent can interact. On this basis, the optimal control sequence in the prediction horizon can be learned through model-based RL, but only the first element is actually executed, and the RL process begins anew after the prediction horizon moves forward. In the simulation, the algorithm's convergence is analyzed and the influence of the prediction horizon length is evaluated. Then, the proposed EMS is compared with DP, conventional MPC, and RL method, the results of which demonstrate its performance and adaptability. As last, a hardware-in-the-loop test validates its actual applicability.

Keywords: Hybrid electric vehicle; Real-time energy management; Model predictive control; Long short-term memory network; Model-based reinforcement learning (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544223003651
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:270:y:2023:i:c:s0360544223003651

DOI: 10.1016/j.energy.2023.126971

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().