Optimal operations planning of electric autonomous vehicles via asynchronous learning in ride-hailing systems

Guodong Yu, Aijun Liu, Jianghua Zhang and Huiping Sun

Omega, 2021, vol. 103, issue C

Abstract: Ride-hailing systems with electric autonomous vehicles are recognized as a next-generation development to ease congestion, reduce costs and carbon emissions. In this paper, we consider the operation planning problem involving vehicle dispatching, relocation, and recharging decisions. We model the problem as a Markov Decision Process (MDP) to generate the optimal policy that maximizes the total profits. We propose a flexible policy to provide optimal actions according to the reward considering future requests and vehicle availability. We show that our model outperforms the predetermined rules on improving profits. To handle the curse-of-dimensionality caused by the large scale of state space and uncertainty, we develop an asynchronous learning method to solve the problem by approximating the value function. We first draw the samples of exogenous information and update the quality of approximations based on the quality of decisions, then approximate the exact cost-to-go value function by solving an approximation subproblem efficiently given the state at each period. Two variant algorithms are presented for cases with scarce and sufficient information. We also incorporate the state aggregation and post-decision analysis to further improve computational efficiency. We use a set of shared actual data from Didi platform to verify the proposed model in numerical experiments. To conclude, we extract managerial insights that suggest important guidelines for the ride-hailing operations planning problem.

Keywords: Ride-hailing service; Flexible operations planning; Markov Decision Process; Asynchronous learning (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0305048321000578
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jomega:v:103:y:2021:i:c:s0305048321000578

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.omega.2021.102448

Access Statistics for this article

Omega is currently edited by B. Lev

More articles in Omega from Elsevier
Bibliographic data for series maintained by Catherine Liu ().