Cascaded foreign object detection in manufacturing processes using convolutional neural networks and synthetic data generation methodology

Jixiang Tang (), Huan Zhou, Tiankui Wang, Zhenxun Jin, Youli Wang and Xuanyin Wang ()
Additional contact information
Jixiang Tang: Zhejiang University
Huan Zhou: Zhejiang University
Tiankui Wang: China Tobacco Zhejiang Industrial Co., Ltd.
Zhenxun Jin: China Tobacco Zhejiang Industrial Co., Ltd.
Youli Wang: China Tobacco Zhejiang Industrial Co., Ltd.
Xuanyin Wang: Zhejiang University

Journal of Intelligent Manufacturing, 2023, vol. 34, issue 7, No 4, 2925-2941

Abstract: Abstract Foreign object detection in manufacturing processes based on machine vision remains a challenge. The vastly different foreign objects and the complex background, as well as the scarcity of images with foreign objects constrain the application of traditional and deep learning methods, respectively. This paper discusses a novel method for intelligent foreign object detection and automatic data generation. A cascaded convolutional neural network to detect foreign objects on the surface of the tobacco pack is proposed. The cascaded network transforms the inspection into a two-stage YOLO based object detection, consisting of the tobacco pack localization and the foreign object detection. To address the scarcity of images with foreign objects, several data augmentation methods are introduced to avoid overfitting. Furthermore, a data generation methodology based on homography transformation and image fusion is developed to generate synthetic images with foreign objects. Models trained using synthetic images generated by this method show superior performance, which presents a viable approach to detecting newly introduced foreign objects. Extensive experimental results and comparisons on the tobacco pack foreign object dataset with several state-of-the-art methods demonstrate the effectiveness and superiority of the proposed method. The proposed cascaded foreign object detection network and synthetic data generation methodology have the potential for widespread applications.

Keywords: Foreign object detection; Machine vision; Convolutional neural network; Data augmentation; Data generation (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10845-022-01976-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:34:y:2023:i:7:d:10.1007_s10845-022-01976-3

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845

DOI: 10.1007/s10845-022-01976-3

Access Statistics for this article

Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak

More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().