Combining Deep Image Prior and Second-Order Generalized Total Variance for Image Inpainting

Shaopei You, Jianlou Xu (), Yajing Fan, Yuying Guo and Xiaodong Wang
Additional contact information
Shaopei You: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China
Jianlou Xu: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China
Yajing Fan: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China
Yuying Guo: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China
Xiaodong Wang: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China

Mathematics, 2023, vol. 11, issue 14, 1-15

Abstract: Image inpainting is a crucial task in computer vision that aims to restore missing and occluded parts of damaged images. Deep-learning-based image inpainting methods have gained popularity in recent research. One such method is the deep image prior, which is unsupervised and does not require a large number of training samples. However, the deep image prior method often encounters overfitting problems, resulting in blurred image edges. In contrast, the second-order total generalized variation can effectively protect the image edge information. In this paper, we propose a novel image restoration model that combines the strengths of both the deep image prior and the second-order total generalized variation. Our model aims to better preserve the edges of the image structure. To effectively solve the optimization problem, we employ the augmented Lagrangian method and the alternating direction method of the multiplier. Numerical experiments show that the proposed method can repair images more effectively, retain more image details, and achieve higher performance than some recent methods in terms of peak signal-to-noise ratio and structural similarity.

Keywords: second-order total generalized variational; alternating direction method; depth image prior; image inpainting (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/14/3201/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/14/3201/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:14:p:3201-:d:1199237

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().