An Improved Matting-SfM Algorithm for 3D Reconstruction of Self-Rotating Objects

Zinuo Li, Zhen Zhang (), Shenghong Luo, Yuxing Cai and Shuna Guo
Additional contact information
Zinuo Li: School of Computer Science and Engineering, Huizhou University, Huizhou 516007, China
Zhen Zhang: School of Computer Science and Engineering, Huizhou University, Huizhou 516007, China
Shenghong Luo: School of Computer Science and Engineering, Huizhou University, Huizhou 516007, China
Yuxing Cai: School of Computer Science and Engineering, Huizhou University, Huizhou 516007, China
Shuna Guo: School of Computer Science and Engineering, Huizhou University, Huizhou 516007, China

Mathematics, 2022, vol. 10, issue 16, 1-20

Abstract: The 3D reconstruction experiment can be performed accurately in most cases based on the structure from motion (SfM) algorithm with the combination of the multi-view stereo (MVS) framework through a video recorded around the object. However, we need to artificially hold the camera and stabilize the recording process as much as possible to obtain better accuracy. To eliminate the inaccurate recording caused by shaking during the recording process, we tried to fix the camera on a camera stand and placed the object on a motorized turntable to record. However, in this case, the background did not change when the camera position was kept still, and the large number of feature points from the background were not useful for 3D reconstruction, resulting in the failure of reconstructing the targeted object. To solve this problem, we performed video segmentation based on background matting to segment the object from the background, so that the original background would not affect the 3D reconstruction experiment. By intercepting the frames in the video, which eliminates the background as the input of the 3D reconstruction system, we could obtain an accurate 3D reconstruction result of an object that could not be reconstructed originally when the PSNR and SSIM increased to 11.51 and 0.26, respectively. It was proved that this algorithm can be applied to the display of online merchandise, providing an easy way for merchants to obtain an accurate model.

Keywords: 3D reconstruction; multi-view stereo; structure from motion; background matting (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/16/2892/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/16/2892/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:16:p:2892-:d:886712

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().