Empty container repositioning problem using a reinforcement learning framework with multi-weight adaptive reward function

Xiaofeng Xu, Xinru Huang and Lianju Wang

Maritime Policy & Management, 2024, vol. 51, issue 8, 1742-1763

Abstract: In logistics networks, empty container congestion and scarcity often stem from trade imbalance and supply-demand mismatch. This paper focuses on the problem of empty container repositioning in maritime logistics and proposes a reinforcement learning framework that integrates a self-adaptive mechanism for adjusting the weights of a multi-objective reward function. The objective is to enhance container utilization and reduce scheduling costs. By reviewing the development of the empty container repositioning problem and analysing the advantages of using reinforcement learning to address the temporal and spatial complexity, the problem is modelled as a Markov decision process and tackled using reinforcement learning techniques. To achieve the optimization objectives, which involve reducing resource shortages at various locations and minimizing resource repositioning costs, a multi-objective reward function is introduced to capture the mutually constrained preferences. The weights of the reward function are dynamically adjusted to account for the potential time-varying preferences of the agent, mitigating the issue of poor generalization performance associated with fixed-weight reward functions. Comparative experimental analysis against conventional reinforcement learning algorithms demonstrates the superior performance of the proposed approach in problem solving. Based on the results and practical requirements of the case study, relevant recommendations for addressing empty container repositioning are presented.

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03088839.2024.2326635 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:marpmg:v:51:y:2024:i:8:p:1742-1763

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TMPM20

DOI: 10.1080/03088839.2024.2326635

Access Statistics for this article

Maritime Policy & Management is currently edited by Dr Kevin Li and Heather Leggate McLaughlin

More articles in Maritime Policy & Management from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().