An Analysis of Generative Methods for Multiple Image Inpainting

Coloma Ballester (), Aurélie Bugeau (), Samuel Hurault (), Simone Parisotto () and Patricia Vitoria ()
Additional contact information
Coloma Ballester: University Pompeu Fabra, IPCV, DTIC
Aurélie Bugeau: CNRS, Université de Bordeaux, LaBRI
Samuel Hurault: Université de Bordeaux, Bordeaux INP, CNRS, IMB
Simone Parisotto: University of Cambridge, DAMTP
Patricia Vitoria: University Pompeu Fabra, IPCV, DTIC

Chapter 20 in Handbook of Mathematical Models and Algorithms in Computer Vision and Imaging, 2023, pp 773-820 from Springer

Abstract: Abstract Image inpainting refers to the restoration of an image with missing regions in a way that is not detectable by the observer. The inpainting regions can be of any size and shape. This is an ill-posed inverse problem that does not have a unique solution. In this work, we focus on learning-based image completion methods for multiple and diverse inpainting which goal is to provide a set of distinct solutions for a given damaged image. These methods capitalize on the probabilistic nature of certain deep generative models to sample various solutions that coherently restore the missing content. Throughout the chapter, we will analyze the underlying theory and analyze the recent proposals for multiple inpainting. To investigate the pros and cons of each method, we present quantitative and qualitative comparisons, on common datasets, regarding both the quality and the diversity of the set of inpainted solutions. Our analysis allows us to identify the most successful generative strategies in both inpainting quality and inpainting diversity. This task is closely related to the learning of an accurate probability distribution of images. Depending on the dataset in use, the challenges that entail the training of such a model will be discussed through the analysis.

Keywords: Inverse problems; Inpainting; Multiple inpainting; Diverse inpainting; Deep learning; Generative methods (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-030-98661-2_119

Ordering information: This item can be ordered from
http://www.springer.com/9783030986612

DOI: 10.1007/978-3-030-98661-2_119

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().