Real-time laser keyhole welding penetration state monitoring based on adaptive fusion images using convolutional neural networks

Wang Cai, Ping Jiang (), LeShi Shu, ShaoNing Geng and Qi Zhou
Additional contact information
Wang Cai: Huazhong University of Science and Technology
Ping Jiang: Huazhong University of Science and Technology
LeShi Shu: Huazhong University of Science and Technology
ShaoNing Geng: Huazhong University of Science and Technology
Qi Zhou: Huazhong University of Science and Technology

Journal of Intelligent Manufacturing, 2023, vol. 34, issue 3, No 17, 1259-1273

Abstract: Abstract In laser keyhole welding process, the penetration state is an important index to evaluate the quality of weld seam. In this paper, an innovative deep learning-based monitoring system capable of diagnosing the penetration state in real time is introduced in detail. The built monitoring platform can capture the interaction zone images during the laser welding through a high-speed camera. An adaptive fusion method of adjacent monitoring images is proposed to eliminate the interference of metal vapor plume in the image and highlight the keyhole and molten pool. A deep learning model based on convolutional neural network is established to model the relationship between the interaction zone fusion images and the corresponding penetration states. The constructed training set and validation set can improve the robustness and generalization ability of the built model. The verification results on unfused original images show that the average classification accuracy can reach 98.37%, with a latency about 2.9 ms. Finally, a results-evaluation strategy is proposed to eliminate misclassified results to achieve the state-of-the-art performance. The evaluation results of the entire verification weld seam indicate that the proposed monitoring system can meet the requirements of real-time monitoring with high accuracy and short latency. This study provides a novel and robust method for laser welding penetration state monitoring.

Keywords: Laser welding; Penetration state monitoring; Keyhole and molten pool; Image fusion; Convolutional neural networks (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10845-021-01848-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:34:y:2023:i:3:d:10.1007_s10845-021-01848-2

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845

DOI: 10.1007/s10845-021-01848-2

Access Statistics for this article

Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak

More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().