A scalable Deep Q-Learning approach for hot stamping process under dynamic control environment

Nuria Nievas, Adela Pagès-Bernaus, Albert Abio, Danillo Lange, Eduard Garcia-Llamas, Marc Grané, Jaume Pujante, Lluís Echeverria and Francesc Bonada

International Journal of Production Research, 2025, vol. 63, issue 8, 2831-2852

Abstract: Despite the significant advancements in Artificial Intelligence and its applications, traditional control techniques still dominate industrial and manufacturing processes. These techniques often rely on static setups and default values, which make them resistant to environmental changes. However, in dynamic and uncertain contexts, real-time process adaptation offers significant advantages in decision-making and control. In this research, we present a novel approach utilising Deep Reinforcement Learning for real-time dynamic parameter adaptation and autonomous control of processes in unpredictable environments. The effectiveness of our proposal is illustrated through the development and training of a Deep Q-Learning control system tailored for optimising a hot stamping process. The control model aims to minimise defect rates and enhance efficiency by reducing forming times during batch productions. Comparative analysis against conventional industry practices, characterised by static and non-adaptive time settings, validates the efficacy of our solution, with improvements of over 20% in the times, depending on the scenario considered. Experimental evaluation in a semi-industrial pilot setting not only demonstrates the adaptability of our approach but also highlights its potential scalability for diverse industrial applications.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/00207543.2024.2411377 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tprsxx:v:63:y:2025:i:8:p:2831-2852

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/TPRS20

DOI: 10.1080/00207543.2024.2411377

Access Statistics for this article

International Journal of Production Research is currently edited by Professor A. Dolgui

More articles in International Journal of Production Research from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().