Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

Jianguo Pan (), Ruirui Zhong (), Bingtao Hu (), Yixiong Feng (), Zhifeng Zhang () and Jianrong Tan ()
Additional contact information
Jianguo Pan: Zhejiang University
Ruirui Zhong: Zhejiang University
Bingtao Hu: Zhejiang University
Yixiong Feng: Zhejiang University
Zhifeng Zhang: Zhejiang University
Jianrong Tan: Zhejiang University

Flexible Services and Manufacturing Journal, 2025, vol. 37, issue 1, No 6, 157-178

Abstract: Abstract The complexity of job-shop environments poses significant challenges for effective scheduling in the manufacturing industry. Flexible job-shop scheduling, in particular, involves coordinating multiple jobs with varying requirements across multiple machines, while considering various constraints and objectives. Traditional scheduling approaches often struggle to handle the dynamic nature inherent in such environments. To address the above challenges, this paper presents a digital twin (DT)-based management framework for hanging workshops, aiming to enhance flexible job-shop scheduling in manufacturing environments. The framework integrates real-time monitoring, condition monitoring, and smart scheduling capabilities to improve overall performance and efficiency. To implement the framework, a smart scheduling methodology based on a graph neural network and deep reinforcement learning (DRL) is devised. Markov Decision Process (MDP) captures the dynamic nature and uncertainties of the hanging workshop, while the graph embedding network technique represents operations, machines, and their relationships in a low-dimensional space. Decision-making is enhanced through training with the Proximal Policy Optimization (PPO) algorithm. Extensive Experiments are conducted to evaluate the framework’s effectiveness. The findings demonstrate the ability of the framework to improve job-shop scheduling performance.

Keywords: Hanging workshop; Flexible job shop problem; Deep reinforcement learning; Graph embedding; Digital twin (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10696-024-09543-z Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:flsman:v:37:y:2025:i:1:d:10.1007_s10696-024-09543-z

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10696

DOI: 10.1007/s10696-024-09543-z

Access Statistics for this article

Flexible Services and Manufacturing Journal is currently edited by Hans Günther

More articles in Flexible Services and Manufacturing Journal from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().