Dynamic scheduling for flexible job-shop with reconfigurable manufacturing cells considering dynamic job arrivals based on deep reinforcement learning

Liang Zheng, Xiaodi Chen, Cunbo Zhuang, Jianhua Liu, Yongyang Zhang and Lijuan Lai

International Journal of Production Research, 2025, vol. 63, issue 20, 7427-7459

Abstract: In smart manufacturing, uncertainties in discrete manufacturing processes are increasing, making efficient dynamic scheduling a critical challenge. This paper addresses the Dynamic Flexible Job Shop Scheduling Problem with Reconfigurable Manufacturing Cells (DFJSP-RMC), considering dynamic job arrivals and aiming to minimise makespan, tardiness, and operation instability. To tackle this problem, a Noisy Dueling Double DQN with Prioritized Experience Replay (ND3QNP) algorithm is proposed. First, the DFJSP-RMC is formulated as a mixed-integer programming problem and transformed into a Markov decision process. Next, 28 state features are designed based on job attributes, reconfigurable manufacturing cell characteristics, and dynamic factors, while 33 actions are derived from heuristic dispatching rules. A reward function is then constructed by integrating makespan, tardiness, and instability. To mitigate overestimation in the original DQN, double Q-learning, a duelling network, and a noisy network are incorporated. Additionally, prioritised experience replay is employed to enhance learning efficiency. Furthermore, an operation insertion strategy is introduced, significantly improving the algorithm's optimisation performance. Finally, experimental results demonstrate that the proposed ND3QNP algorithm outperforms classical dispatching rules and state-of-the-art deep reinforcement learning approaches in terms of makespan, total tardiness, and operation instability, showcasing its robustness in dynamic and reconfigurable manufacturing environments.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2025.2497961 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:63:y:2025:i:20:p:7427-7459

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2025.2497961

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().