CD3IS: cross dimensional 3D instance segmentation network for production workshop

Zaizuo Tang, Guangzhu Chen (), Ruili Wang, Zhenlian Miao, Manna Dai, Yujun Ma and Xiaojuan Liao
Additional contact information
Zaizuo Tang: Chengdu University of Technology
Guangzhu Chen: Chengdu University of Technology
Ruili Wang: Massey University
Zhenlian Miao: Chengdu University of Technology
Manna Dai: Agency for Science, Technology and Research (A*STAR)
Yujun Ma: Massey University
Xiaojuan Liao: Chengdu University of Technology

Journal of Intelligent Manufacturing, 2024, vol. 35, issue 7, No 15, 3273-3289

Abstract: Abstract Three-dimensional (3D) instance segmentation, as an effective method for scene object recognition, can effectively enhance workshop intelligence. However, the existing 3D instance segmentation network is difficult to apply in workshop scenes due to the large number of 3D instance segmentation labels and 3D information acquisition devices required. In this paper, a monocular 3D instance segmentation network is proposed, which achieves satisfactory results while relying on a monocular RGB camera without 3D instance segmentation labels. The proposed method has two stages. In the first stage, the double-snake multitask network is proposed to solve the problem of a lack of 3D information acquisition devices. It simultaneously performs depth estimation and instance segmentation and uses the features obtained from depth estimation to guide the instance segmentation task. In the second stage, an adaptive point cloud filtering algorithm that performs adaptive point cloud noise filtering on multi-scale objects based on two-dimensional prior information is proposed to solve the problem of a lack of 3D labels. In addition, color information is introduced into the filtering process to further improve filtering accuracy. Experiments on the Cityscapes and SOP datasets demonstrate the competitive performance of the proposed method. When the IoU threshold is set to 0.35, the mean average precision (mAP) is 50.41. Our approach is deployed in an actual production workshop to verify its feasibility.

Keywords: 3D instance segmentation; Depth estimation; Multitask learning; Production workshop (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10845-023-02200-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joinma:v:35:y:2024:i:7:d:10.1007_s10845-023-02200-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10845

DOI: 10.1007/s10845-023-02200-6

Access Statistics for this article

Journal of Intelligent Manufacturing is currently edited by Andrew Kusiak

More articles in Journal of Intelligent Manufacturing from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().