Digital twin application with horizontal coordination for reinforcement-learning-based production control in a re-entrant job shop

Kyu Tae Park, Seung-Woo Jeon and Sang Do Noh

International Journal of Production Research, 2022, vol. 60, issue 7, 2151-2167

Abstract: In a re-entrant job shop (RJS), an entity can visit the same resource type multiple times; this is called re-entrancy, which occurs frequently in actual industries. Re-entrancy causes an NP-hard problem and is dominated by heuristics-based production control. The stochastic arrivals due to re-entrancy require the design of an appropriate dispatching rule. Reinforcement learning (RL) is an efficient technique for establishing robust dispatching rules; however, only a few cases that coordinate RL-based production control with a digital twin (DT) have been reported. This study proposes a novel production control model that applies a DT and horizontal coordination with RL-based production control. The requirements for dispatching in the RJS and coordination between RL and the DT were defined. A suitable architectural framework, service composition, and systematic logic library schema were developed to exploit the advanced characteristics of the DT and improve the existing production control methods. This study is an early case of coordinating RL and DT, and the findings revealed that RL policy networks should be imported in the creation procedures rather than being synchronised to the DT. The results should be a valuable reference for research on other types of RL-based production control with regard to horizontal coordination.

Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2021.1884309 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:60:y:2022:i:7:p:2151-2167

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2021.1884309

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().