Learning-based hybrid algorithms for container relocation problem with storage plan

Peixiang Wang, Qihang Xu, Yufei Li, Qunlong Chen, Jinghan Tao, Wei Qin, Heng Huang and Ying Zou

Transportation Research Part E: Logistics and Transportation Review, 2025, vol. 197, issue C

Abstract: Container relocation poses a challenge in terminals, underscoring the importance of effective strategies to maintain efficient cargo flow. This paper tackles the Container Relocation Problem with Storage Plan (CRPSP) by integrating exact algorithms and reinforcement learning. We formulate the problem with a mixed-integer programming model and employ an A* algorithm to generate optimal solutions. We then design a reinforcement learning PPO model with an attention mechanism. A key contribution is the designed reward mechanism based on a lower-bound evaluation function of the A* algorithm, which significantly accelerates the convergence of the reinforcement learning model. Additionally, ensemble learning techniques, specifically Stacking, are first used to integrate multiple reinforcement learning models based on optimal solutions. Numerical experiments demonstrate notable improvements in convergence speed and robustness, highlighting the potential of combining operations research methods and machine learning for complex NP-hard problems.

Keywords: Container relocation; Reinforcement learning; A* algorithm; Reward mechanism; Ensemble learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1366554525000894
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:transe:v:197:y:2025:i:c:s1366554525000894

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600244/bibliographic
http://www.elsevier. ... 600244/bibliographic

DOI: 10.1016/j.tre.2025.104048

Access Statistics for this article

Transportation Research Part E: Logistics and Transportation Review is currently edited by W. Talley

More articles in Transportation Research Part E: Logistics and Transportation Review from Elsevier
Bibliographic data for series maintained by Catherine Liu ().