Flexible material handling system for multi-load autonomous mobile robots in manufacturing environments: a hierarchical reinforcement learning approach

Keonwoo Park, Seongbae Jo, Youngchul Shin and Ilkyeong Moon

International Journal of Production Research, 2025, vol. 63, issue 15, 5671-5691

Abstract: The increasing complexity of customer demands has led to the implementation of flexible job-shop scheduling and automated material handling systems across manufacturing sectors. In particular, advances in robotic technology have made autonomous mobile robots (AMRs) essential for material handling tasks within these sectors. The capability of free movement, path planning, and loading multiple work-in-processes (WIPs) can significantly enhance the efficiency of material handling operations. However, the full flexibility of AMRs cannot be utilised when their decisions regarding the sequence of loading and unloading multiple WIPs are made by specific rule-based operations, resulting in inefficiencies in the throughput of WIPs in manufacturing environments. To address this inefficiency, we introduce a hierarchical reinforcement learning algorithm to optimise material handling with AMRs, thereby maximising the throughput of WIPs. In this approach, a graph attention network (GAT) serves as an encoder for the hierarchical reinforcement learning (HRL) input, effectively capturing the complex relationships between different nodes. Computational experiments demonstrate that our approach enhances the efficiency of the material handling system more effectively than existing rule-based methods.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2025.2461131 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:63:y:2025:i:15:p:5671-5691

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2025.2461131

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().