High-dimensional categorical process monitoring: A data mining approach

Kai Wang and Zhenli Song

IISE Transactions, 2025, vol. 57, issue 9, 1088-1104

Abstract: The advent of industrial big data has provided an unprecedented opportunity to achieve a data-driven monitoring of large-scale complex processes. When a process involves massive categorical variables each evaluated by attribute levels rather than real numbers, which is common in modern manufacturing and service applications, the existing process monitoring methods typically fail in modeling the joint distribution of these categorical variables due to the curse of high dimensionality. To fill this research gap, we propose a novel data mining–based framework—a nonparametric method—for High-Dimensional (HD) categorical process monitoring. Specifically, a series of multiscale frequent patterns are particularly defined and quickly extracted to characterize both the significant individual behaviors and the major collective behaviors of HD categorical variables. Then all these discovered multiscale patterns, serving as informative surrogates of the original HD categorical data, are monitored sequentially from low scale to high scale via a principled and powerful multiple hypotheses testing procedure embedded with an alpha spending function and a false discovery rate approach. The superiority of our proposed method is validated extensively by numerical simulations and real case studies. It is capable of maintaining a desired false alarm rate when the process is normal and becoming very sensitive to many different kinds of process shifts.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/24725854.2024.2399653 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:uiiexx:v:57:y:2025:i:9:p:1088-1104

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/uiie20

DOI: 10.1080/24725854.2024.2399653

Access Statistics for this article

IISE Transactions is currently edited by Jianjun Shi

More articles in IISE Transactions from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().