Accelerated Scheduling Heuristics for Reinforcement Learning Approaches Applied to the Westenberger–Kallrath Problem

Philipp Willms ()
Additional contact information
Philipp Willms: University of Kassel, Chair of Supply Chain Management

A chapter in Operations Research Proceedings 2024, 2025, pp 451-457 from Springer

Abstract: Abstract In the chemical process industry (CPI), production planning and scheduling (PPS) problems show a variety of characteristics which increases the complexity of corresponding modeling approaches and solution techniques. For recent years, the concept of reinforcement learning (RL) has been evaluated for its effectiveness to solve PPS problems for multiple case studies in discrete manufacturing. Our study delves into the utilization of RL to address the Westenberger–Kallrath (WK) problem which is a prominent benchmark for chemical production planning. The proposed solution approach decouples the lotsizing part from the scheduling activity via a custom MRP heuristic which creates chains of batches linked to customer orders. We train an RL agent to sequence those chains with the objective to minimize overall makespan. Building on our previous work, which used a custom forward scheduling heuristic with an internal inventory projection, we propose a new scheduling logic based on minimum waiting times between the multi-stage processes and their assigned resources. We provide a CPU time comparison between two implementation approaches, which proves the efficiency of our new method. Using the new logic in RL agent training, we detect parameter configuration as key algorithmic challenge for further studies.

Keywords: Reinforcement learning; Production scheduling; Process industry (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:lnopch:978-3-031-92575-7_64

Ordering information: This item can be ordered from
http://www.springer.com/9783031925757

DOI: 10.1007/978-3-031-92575-7_64

Access Statistics for this chapter

More chapters in Lecture Notes in Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().