An unsupervised embedding method based on streaming videos for process monitoring in repetitive production systems

Yifan Li, Zhi-hai Zhang, Xiaowei Yue and Li Zheng

IISE Transactions, 2025, vol. 57, issue 6, 724-739

Abstract: Advanced production systems, such as multi-step assembly processes, predominantly comprise of repetitive operations. The repetitive manual or human–robot integrated production operations call for new real-time process management technologies such as the increasing use of sensors and the development of system intelligence. Conventional process monitoring and management methods, which are often labor-intensive, fall short in providing immediate and actionable insights. To tackle this limitation, we develop an unsupervised embedding method to automatically delineate the process into different stages and predict real-time progress information. We propose a Contrastive Variational Autoencoder as a feature extractor to adeptly embed repetitive processes into a Gaussian Mixture Model. Based on the extracted features, we propose an adaptive change-point detection and an Iterative Dynamic Time Wrapping algorithm to identify and segment multiple standardized process stages automatically. Theoretically, we establish the asymptotic optimality of the detected change-points associated with the given precision of image and feature extractors, ensuring the high-quality process stage separation and labeling. The proposed method autonomously extracts essential features encapsulating progress information from a limited set of unlabelled process videos. Through four diverse case studies including production of an actual aircraft spoiler, our method exhibits very promising performance. Specifically, it achieves an average of 98.14% accuracy in predicting production progress and 0.9202 area under the curve in predicting progress deviation across three distinct production environments. The proposed process monitoring method in repetitive production systems has the potential to significantly improve productivity, promote standardization of repetitive operations, and predict production deviations.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/24725854.2024.2386415 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:uiiexx:v:57:y:2025:i:6:p:724-739

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/uiie20

DOI: 10.1080/24725854.2024.2386415

Access Statistics for this article

IISE Transactions is currently edited by Jianjun Shi

More articles in IISE Transactions from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().