Multi-agent reinforcement learning based on graph convolutional network for flexible job shop scheduling

Xuan Jing (), Xifan Yao (), Min Liu () and Jiajun Zhou ()
Additional contact information
Xuan Jing: South China University of Technology
Xifan Yao: South China University of Technology
Min Liu: Guangxi University of Science and Technology
Jiajun Zhou: China University of Geosciences

Journal of Intelligent Manufacturing, 2024, vol. 35, issue 1, No 5, 75-93

Abstract: Abstract With the development of Internet of manufacturing things, decentralized scheduling in flexible job shop is arousing great attention. To deal with the challenges confronted by personalized manufacturing, such as high level of flexibility, agility and robustness for dynamic response, we design a centralized-learning decentralized-execution (CLDE) multi-agent reinforcement learning scheduling structure based on Graph Convolutional Network (GCN), namely graph-based multi-agent system (GMAS), to solve the flexible job shop scheduling problem (FJSP). Firstly, according to the product processing network and job shop environment, the probabilistic model of directed acyclic graph for FJSP is constructed. It models the FJSP as the process of topology graph structure predicting, and the scheduling strategy is adjusted by predicting the connection probability among edges. Then, the multi-agent reinforcement learning system consisting of environment module, job agent module, and machine agent module is constructed. The job agents execute scheduling actions by interacting with environment and machine agents in a decentralized way. Meanwhile, the interaction between job agents is extracted as an abstract global action based on GCN. The experimental results demonstrate that GMAS outperforms its rivals on FJSP, especially in complicated situations. Our results thus shed light on a novel direction for FJSP in dynamic and complex scenarios.

Keywords: Flexible job shop scheduling; Multi-agent system; Reinforcement learning; Graph convolutional network (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10845-022-02037-5 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:35:y:2024:i:1:d:10.1007_s10845-022-02037-5

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845

DOI: 10.1007/s10845-022-02037-5

Access Statistics for this article

Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak

More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().