Confidence-aware reinforcement learning for energy management of electrified vehicles

Jingda Wu, Chao Huang, Hongwen He and Hailong Huang

Renewable and Sustainable Energy Reviews, 2024, vol. 191, issue C

Abstract: The reliability of data-driven techniques, such as deep reinforcement learning (DRL) frequently diminishes in scenarios beyond their training environments. Despite DRL-based energy management strategies (EMS) having gained great popularity in optimizing the energy economy of electrified vehicles (EVs), their performance degradation in untrained contexts has not received adequate attention. This study presents a confidence-aware EMS designed to mitigate this problem and thereby enhance the overall EMS functionality. Firstly, a deep ensemble model-based uncertainty evaluation method is developed for devising a confidence assessment mechanism to measure the reliability of DRL actions. On this basis, a confidence-aware DRL-based strategy is proposed, wherein a knowledge-driven approach replaces DRL actions in instances of low confidence, aiming to improve overall performance. For validation, a fuel cell EV with complex energy flow was used as the testbed, and our proposed EMS was trained with the aim of optimizing fuel cell system energy consumption, battery longevity, and capacity maintenance. Both the confidence mechanism and the proposed EMS were evaluated using real-world driving profiles. Results suggest the established confidence mechanism accurately represents the DRL’s performance across different situations. In addition, the proposed EMS outperforms existing DRL-based EMS by 4.0% in hydrogen economy without compromising other objectives. The comprehensive architecture of the proposed amalgamation of data-driven and knowledge-driven methodologies can be effectively tailored to analogous energy management problems, thereby contributing to advancements in related fields.

Keywords: Energy management; Data-driven; Reinforcement learning; Reliability awareness; Knowledge fusion; Fuel cell electric vehicle (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1364032123010122
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:rensus:v:191:y:2024:i:c:s1364032123010122

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/bibliographic
http://www.elsevier. ... 600126/bibliographic

DOI: 10.1016/j.rser.2023.114154

Access Statistics for this article

Renewable and Sustainable Energy Reviews is currently edited by L. Kazmerski

More articles in Renewable and Sustainable Energy Reviews from Elsevier
Bibliographic data for series maintained by Catherine Liu ().