A deep reinforcement learning based algorithm for a distributed precast concrete production scheduling

Yu Du and Jun-qing Li

International Journal of Production Economics, 2024, vol. 268, issue C

Abstract: The environmental-friendly production demands higher manufacturing efficiency and lower energy cost; therefore, time-of-use electricity price constraint and distributed production have attracted more attention. For concrete precast architecture construction, the tardiness penalty and warehouse cost cannot be ignored, which should be optimized for lower cost. In this study, the concrete precast process is investigated as the group scheduling of a distributed flexible job shop problem. Each concrete precast is managed in a group, the setup time between different groups is considered. Two objectives, total weighted earliness and tardiness and total time-of-use electricity cost are minimized, simultaneously. To solve the integrated problem, three coordinated double deep Q-networks (DQN) are applied, which are organized as a learn-to-improve reinforcement learning approach. For distributed scheduling problem, operators in a single factory or in multiple factories differs in solution improvement; so selection DQN is designed to decide the type of the operators according to scheduling circumstances. Other two DQNs, i.e., local DQN and global DQN, are to select the optimization operators in one factory or in multiple factories, respectively. Furthermore, two solution refinement strategies are designed to decrease the objectives after reinforcement learning component. Numerical experiment and statistical analysis suggest that the proposed deep reinforcement learning based algorithm has superiority in solving the considered problem.

Keywords: Reinforcement learning; Precast concrete production; Distributed flexible job shop scheduling problem; Group scheduling; Time-of-use electricity price (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0925527323003341
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:proeco:v:268:y:2024:i:c:s0925527323003341

DOI: 10.1016/j.ijpe.2023.109102

Access Statistics for this article

International Journal of Production Economics is currently edited by Stefan Minner

More articles in International Journal of Production Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().