DQL energy management: An online-updated algorithm and its application in fix-line hybrid electric vehicle

Runnan Zou, Likang Fan, Yanrui Dong, Siyu Zheng and Chenxing Hu

Energy, 2021, vol. 225, issue C

Abstract: With decades’ development of energy management strategy in hybrid electric vehicle, learning-based method has been deemed as a key solution for energy economy and real time. However, current energy management strategy cannot reach an optimal energy economy performance and online update in a tolerable time lag. Aiming at solving these problems, an accelerated reinforcement learning method and an online-updated strategy are proposed in present work. Firstly, prioritized replay is applied in deep Q network with normalized advantage function for a fast convergence to an optimal strategy. Prioritized replay module endows weight to trained history data which is utilized in neural network training. The neural network is updated towards optimal strategy by weight in an effective way. Secondly, the online-updated strategy for fix-line hybrid electric vehicle is designed based on the accelerated reinforcement learning method and model predictive control. The predicted future road information generated by model predictive control in each time interval is delivered to the accelerated reinforcement learning module for online energy management strategy generating. Finally, with all efforts above, the online-updated strategy is carried out and validated through hardware-in-the-loop simulation. The results show that this approach promotes the energy economic performance while updating strategy in real time.

Keywords: Online-updated energy management strategy; Prioritized replay; Model predictive control; Deep Q learning; Hybrid electric vehicle (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544221004230
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:225:y:2021:i:c:s0360544221004230

DOI: 10.1016/j.energy.2021.120174

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().