Long-term efficient energy management for multi-station collaborative electric vehicle charging: A transformer-based multi-agent reinforcement learning approach

Ge Song, Hongbin Xie, Jingyuan Zhang, Hongdi Fu, Zhuoran Shi, Defan Feng, Xuan Song and Haoran Zhang

Applied Energy, 2025, vol. 397, issue C, No S0306261925010451

Abstract: With the rapid adoption and increasing sales of electric vehicles, energy management for electric vehicle charging and maximizing the utilization of green energy have become increasingly critical. Existing studies have demonstrated that reinforcement learning plays a key role in enhancing power dispatch efficiency. However, in complex scenarios involving multiple stations and charging sites, significant challenges remain in leveraging mutual information to capture long-term temporal relationships and addressing the massive state and action spaces. To fill the research gaps in large-scale data, significant long-term temporal dependencies, and communication challenges in multi-station collaborative electric vehicle charging energy management, we propose a transformer-based multi-agent reinforcement learning algorithm, MAHEM. This algorithm leverages the popular transformer model to capture long-term temporal features in sequential data during distributed execution. By utilizing the transformer architecture, our method reduces the complexity of the action space through Q-value decomposition. Different agents effectively communicate through the attention mechanism, while the transformer model efficiently captures long-term temporal information, accelerating training and convergence by predicting future states. Experimental results show that, compared to existing baselines, our method reduces the total charging cost across stations by 31.6 % and achieves optimal performance across various environments, robustness tests, and transfer tests. This highlights the practicality and effectiveness of MAHEM in addressing the challenges of EV energy management systems.

Keywords: Energy management; Electric vehicle charging; Transformer; Multi-agent reinforcement learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261925010451
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:397:y:2025:i:c:s0306261925010451

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2025.126315

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().