Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Xiyan Zheng, Chengji Liang, Yu Wang (), Jian Shi and Gino Lim
Additional contact information
Xiyan Zheng: Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai 201306, China
Chengji Liang: Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai 201306, China
Yu Wang: Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai 201306, China
Jian Shi: Department of Engineering Technology, University of Houston, Houston, TX 77004, USA
Gino Lim: Department of Industrial Engineering, University of Houston, Houston, TX 77004, USA

Mathematics, 2022, vol. 10, issue 23, 1-19

Abstract: With the rapid development of global trade, ports and terminals are playing an increasingly important role, and automatic guided vehicles (AGVs) have been used as the main carriers performing the loading/unloading operations in automated container terminals. In this paper, we investigate a multi-AGV dynamic scheduling problem to improve the terminal operational efficiency, considering the sophisticated complexity and uncertainty involved in the port terminal operation. We propose to model the dynamic scheduling of AGVs as a Markov decision process (MDP) with mixed decision rules. Then, we develop a novel adaptive learning algorithm based on a deep Q-network (DQN) to generate the optimal policy. The proposed algorithm is trained based on data obtained from interactions with a simulation environment that reflects the real-world operation of an automated in Shanghai, China. The simulation studies show that, compared with conventional scheduling methods using a heuristic algorithm, i.e., genetic algorithm (GA) and rule-based scheduling, terminal the proposed approach performs better in terms of effectiveness and efficiency.

Keywords: Multi-AGV scheduling; automated container terminal; mixed decision rules; deep reinforcement learning; simulation-based algorithm analysis (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/23/4575/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/23/4575/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:23:p:4575-:d:992042

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().