Q(λ) learning-based dynamic route guidance algorithm for overhead hoist transport systems in semiconductor fabs

Illhoe Hwang and Young Jae Jang

International Journal of Production Research, 2020, vol. 58, issue 4, 1199-1221

Abstract: A learning-based dynamic routing algorithm is proposed for the overhead hoist transport (OHT) systems of semiconductor fabrication facilities (fabs). An OHT system, which consists of multiple vehicles moving at high speeds on guided rails, is the primary automated material-handling system (AMHS) in a fab. Modern large-scale fabs have hundreds of vehicles moving lots between multiple processing machines. The dynamic routing method is a route guidance method that dynamically selects the best vehicle paths under given traffic conditions and congestion levels. Building on the $Q(\lambda ) $Q(λ) learning method, we develop a reinforcement learning-based dynamic routing algorithm called QLBWR(λ), which consists of a Boltzmann softmax policy and a reward function. The proposed algorithm uses real-time information to effectively guide each vehicle so that it avoids congestion and finds an efficient path. The algorithm is also designed with a low computational burden, such that the efficient route can be found for hundreds of vehicles in real time. Simulation analyses on an actual fab layout are used to compare the performance of the proposed algorithm with common static and dynamic algorithms. The results show that the proposed algorithm outperforms the benchmarking algorithms.

Date: 2020
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2019.1614692 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:58:y:2020:i:4:p:1199-1221

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2019.1614692

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().