Privacy-preserving integrated thermal and energy management of multi connected hybrid electric vehicles with federated reinforcement learning

Arash Khalatbarisoltani, Jie Han, Muhammad Saeed, Cong-zhi Liu and Xiaosong Hu

Applied Energy, 2025, vol. 385, issue C, No S0306261925001163

Abstract: Deep reinforcement learning (DRL) algorithms have demonstrated impressive performance in developing optimal energy management strategies (EMSs) for individual hybrid electric vehicles (HEVs) under predefined driving cycles. However, in this area of research, the impact of thermal loads and thermal management (TM) is often overlooked. Moreover, HEVs may encounter unseen driving patterns that can hinder the overall performance of EMS. Connected HEVs (C-HEVs) show promising solutions; however, there are existing issues such as privacy, security, and communication loads. This paper proposes a novel integrated thermal and energy management (ITEM) approach based on federated reinforcement learning (FRL) for achieving a generalized policy across multiple C-HEVs. This framework broadens learning from multiple environments while preserving local HEV data privacy and security. The proposed FRL algorithm is iteratively executed between multiple HEVs and a cloud-based center to develop global policies for all ITEMs. For each ITEM, two DRL agents (cabin TM and EMS) build their local policies based on recorded driving data. The only local and global models exchanged between the cloud-based center and the ITEMs reduce communication overhead and preserve driving data privacy. Our findings successfully demonstrate that this approach has the advantage of accelerating convergence speed and achieving total rewards similar to the DRL strategy, which has access to driving cycle information in advance. Furthermore, we demonstrate that the proposed approach delivers excellent performance even when additional DRL agents join the FRL network. The implementation capability is also verified by a hardware-in-the-loop (HIL) test setup.

Keywords: Federated learning (FL); Deep reinforcement learning (DRL); Integrated thermal and energy management (ITEM); Connected and autonomous vehicles (CAVs); Hybrid electric vehicle (HEV) (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261925001163
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:385:y:2025:i:c:s0306261925001163

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2025.125386

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().