A block coordinate variable metric forward–backward algorithm

Emilie Chouzenoux (), Jean-Christophe Pesquet and Audrey Repetti
Additional contact information
Emilie Chouzenoux: Université Paris-Est Marne-la-Vallée
Jean-Christophe Pesquet: Université Paris-Est Marne-la-Vallée
Audrey Repetti: Heriot-Watt University

Journal of Global Optimization, 2016, vol. 66, issue 3, No 5, 457-485

Abstract: Abstract A number of recent works have emphasized the prominent role played by the Kurdyka-Łojasiewicz inequality for proving the convergence of iterative algorithms solving possibly nonsmooth/nonconvex optimization problems. In this work, we consider the minimization of an objective function satisfying this property, which is a sum of two terms: (i) a differentiable, but not necessarily convex, function and (ii) a function that is not necessarily convex, nor necessarily differentiable. The latter function is expressed as a separable sum of functions of blocks of variables. Such an optimization problem can be addressed with the Forward–Backward algorithm which can be accelerated thanks to the use of variable metrics derived from the Majorize–Minimize principle. We propose to combine the latter acceleration technique with an alternating minimization strategy which relies upon a flexible update rule. We give conditions under which the sequence generated by the resulting Block Coordinate Variable Metric Forward–Backward algorithm converges to a critical point of the objective function. An application example to a nonconvex phase retrieval problem encountered in signal/image processing shows the efficiency of the proposed optimization method.

Keywords: Nonconvex optimization; Nonsmooth optimization; Proximity operator; Majorize–Minimize algorithm; Block coordinate descent; Alternating minimization; Phase retrieval; Inverse problems; 90C25; 90C26; 65K10; 65F08; 49M27; 68U10; 94A08; 90C05 (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://link.springer.com/10.1007/s10898-016-0405-9 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jglopt:v:66:y:2016:i:3:d:10.1007_s10898-016-0405-9

Ordering information: This journal article can be ordered from
http://www.springer. ... search/journal/10898

DOI: 10.1007/s10898-016-0405-9

Access Statistics for this article

Journal of Global Optimization is currently edited by Sergiy Butenko

More articles in Journal of Global Optimization from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().