Multi-Agent reinforcement learning framework for addressing Demand-Supply imbalance of Shared Autonomous Electric Vehicle

Chengqi Liu, Zelin Wang, Zhiyuan Liu and Kai Huang

Transportation Research Part E: Logistics and Transportation Review, 2025, vol. 197, issue C

Abstract: A critical issue in the operation of one-way station-based Shared Autonomous Electric Vehicles (SAEVs) is addressing the supply–demand imbalance. Supply-side relocations can transfer vehicles from areas with excess supply to areas with higher demand, thereby satisfying more passenger needs and increasing operator profits. To tackle the limitations of current algorithms, which fail to effectively capture similar relocation actions through spatio-temporal relationships, this paper designs a zone-based Dynamic Clustering-Driven Multi-Agent Reinforcement Learning (DC-MARL) model. The approach uses dynamic clustering to pre-cluster historical states for each time step and classifies them in real-time during training and testing. A heterogeneous action space is designed, and an optimization method is employed to determine the specific vehicles for final relocation, mapping the actions to vehicle relocation. An Entity-Agent Reshaped algorithm based on Multi-Agent Deep Deterministic Policy Gradient (EAR-MADDPG) is proposed, along with treatments to enhance cooperation among agents. Experimental results on the Suzhou Industrial Park (SIP) network demonstrate that the proposed method achieves better performance with fewer relocations compared to rule-based relocation and RL-based methods. The proposed method increases profit by 11.80% over the threshold method and by 4.25% over the advanced static clustering method.

Keywords: Vehicle sharing; Relocation; Imbalance problem; Operation decision; Reinforcement learning; Large-scale network optimization (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1366554525001036
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:transe:v:197:y:2025:i:c:s1366554525001036

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600244/bibliographic
http://www.elsevier. ... 600244/bibliographic

DOI: 10.1016/j.tre.2025.104062

Access Statistics for this article

Transportation Research Part E: Logistics and Transportation Review is currently edited by W. Talley

More articles in Transportation Research Part E: Logistics and Transportation Review from Elsevier
Bibliographic data for series maintained by Catherine Liu ().