Cooperative Learning for Smart Charging of Shared Autonomous Vehicle Fleets

Ramin Ahadi (), Wolfgang Ketter (), John Collins () and Nicolò Daina ()
Additional contact information
Ramin Ahadi: Faculty of Management, Economics and Social Science, University of Cologne, 50923 Cologne, Germany
Wolfgang Ketter: Faculty of Management, Economics and Social Science, University of Cologne, 50923 Cologne, Germany; Rotterdam School of Management, Erasmus University Rotterdam, 3062 PA Rotterdam, Netherlands
John Collins: Computer Science and Engineering, University of Minnesota, Minneapolis, Minnesota 55455
Nicolò Daina: Civil Engineering & Engineering Mechanics and Center on Global Energy Policy, Columbia University, New York, New York 10027

Transportation Science, 2023, vol. 57, issue 3, 613-630

Abstract: We study the operational problem of shared autonomous electric vehicles that cooperate in providing on-demand mobility services while maximizing fleet profit and service quality. Therefore, we model the fleet operator and vehicles as interactive agents enriched with advanced decision-making aids. Our focus is on learning smart charging policies (when and where to charge vehicles) in anticipation of uncertain future demands to accommodate long charging times, restricted charging infrastructure, and time-varying electricity prices. We propose a distributed approach and formulate the problem as a semi-Markov decision process to capture its stochastic and dynamic nature. We use cooperative multiagent reinforcement learning with reshaped reward functions. The effectiveness and scalability of the proposed model are upgraded through deep learning. A mean-field approximation deals with environment instabilities, and hierarchical learning distinguishes high-level and low-level decisions. We evaluate our model using various numerical examples based on real data from ShareNow in Berlin, Germany. We show that the policies learned using our decentralized and dynamic approach outperform central static charging strategies. Finally, we conduct a sensitivity analysis for different fleet characteristics to demonstrate the proposed model’s robustness and provide managerial insights into the impacts of strategic decisions on fleet performance and derived charging policies.

Keywords: autonomous vehicles; shared mobility; smart charging; multiagent reinforcement learning (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/trsc.2022.1187 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ortrsc:v:57:y:2023:i:3:p:613-630

Access Statistics for this article

More articles in Transportation Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().