Analysis of Fully Preconditioned Alternating Direction Method of Multipliers with Relaxation in Hilbert Spaces

Hongpeng Sun ()
Additional contact information
Hongpeng Sun: Renmin University of China

Journal of Optimization Theory and Applications, 2019, vol. 183, issue 1, No 11, 199-229

Abstract: Abstract Alternating direction method of multipliers is a powerful first-order method for non-smooth optimization problems including various applications in inverse problems and imaging. However, there is no clear result on the weak convergence of alternating direction method of multipliers in infinite-dimensional Hilbert spaces with relaxation. In this paper, by employing a kind of partial gap analysis, we prove the weak convergence of a general preconditioned and relaxed version in infinite-dimensional Hilbert spaces, with preconditioning for solving all the involved implicit equations under mild conditions. We also give the corresponding ergodic convergence rates respecting to the partial gap function. Furthermore, the connections between certain preconditioned and relaxed alternating direction method of multipliers and the corresponding Douglas–Rachford splitting methods are discussed. Numerical tests show the efficiency of the proposed overrelaxation variants with preconditioning.

Keywords: Alternating direction method of multipliers; Relaxation; Linear preconditioners technique; Weak convergence analysis; Douglas–Rachford splitting; Image reconstruction; 65K10; 90C25; 65F08 (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10957-019-01535-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:183:y:2019:i:1:d:10.1007_s10957-019-01535-6

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-019-01535-6

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().