A golden ratio proximal alternating direction method of multipliers for separable convex optimization

Hongmei Chen (), Guoyong Gu () and Junfeng Yang ()
Additional contact information
Hongmei Chen: Nanjing University
Guoyong Gu: Nanjing University
Junfeng Yang: Nanjing University

Journal of Global Optimization, 2023, vol. 87, issue 2, No 12, 602 pages

Abstract: Abstract Separable convex optimization problems often arise from large scale applications, and alternating direction method of multipliers (ADMM), due to its ability to utilize the separable structure of the objective function, has become an extremely popular approach for solving this class of problems. However, the convergence of the primal iterates generated by ADMM is not guaranteed and the ADMM subproblems can be computationally demanding. Proximal ADMM (PADMM), which introduces proximal terms to the ADMM subproblems, not only guarantees convergence of both the primal and the dual iterates but also is able to take advantage of the problem structures. In this paper, by adopting a convex combination technique we propose a new variant of the classical ADMM, which we call golden ratio proximal ADMM (GrpADMM) as the golden ratio appears to be a key parameter. GrpADMM preserves all the favorable features of PADMM, such as the ability to take full use of problem structures and global convergence under relaxed parameter condition. We show that GrpADMM shares the $${\mathcal {O}}({1}/{N})$$ O ( 1 / N ) ergodic sublinear convergence rate, where N denotes the iteration counter. Furthermore, as long as one of the functions in the objective is strongly convex, the algorithm can be modified to achieve faster $${\mathcal {O}}(1/N^2)$$ O ( 1 / N 2 ) ergodic convergence. Finally, we demonstrate the performance of the proposed algorithms via preliminary numerical experiments.

Keywords: Separable convex optimization; Linear equality constrained; Alternating direction method of multipliers; Proximal; Golden ratio; Ergodic convergence (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s10898-022-01154-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jglopt:v:87:y:2023:i:2:d:10.1007_s10898-022-01154-y

Ordering information: This journal article can be ordered from
http://www.springer. ... search/journal/10898

DOI: 10.1007/s10898-022-01154-y

Access Statistics for this article

Journal of Global Optimization is currently edited by Sergiy Butenko

More articles in Journal of Global Optimization from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().