Efficient Parameter-Free Restarted Accelerated Gradient Methods for Convex and Strongly Convex Optimization

Arnesh Sujanani () and Renato D. C. Monteiro ()
Additional contact information
Arnesh Sujanani: University of Waterloo
Renato D. C. Monteiro: Georgia Institute of Technology

Journal of Optimization Theory and Applications, 2025, vol. 206, issue 2, No 31, 42 pages

Abstract: Abstract This paper develops a new parameter-free restarted method, namely RPF-SFISTA, and a new parameter-free aggressive regularization method, namely A-REG, for solving strongly convex and convex composite optimization problems, respectively. RPF-SFISTA has the major advantage that it requires no knowledge of both the strong convexity parameter of the entire objective and the Lipschitz constant of the gradient of its smooth part. Unlike several other restarted first-order methods which restart an accelerated composite gradient (ACG) method after a predetermined number of ACG iterations, RPF-SFISTA checks a key inequality at each of its iterations to determine whether to restart. Extensive computational experiments show that RPF-SFISTA is roughly 3 to 15 times faster than other state-of-the-art restarted methods on four important classes of problems. The A-REG method, developed for convex composite optimization, solves each of its strongly convex regularized subproblems according to a stationarity criterion by using RPF-SFISTA with an aggressive initial estimate of the strong convexity parameter of the objective. This scheme is thus more aggressive than several other regularization methods which instead solve their subproblems by running a standard ACG method for a predetermined number of iterations.

Keywords: First-order methods; Parameter-free methods; Acceleration; Restarted method; Complexity; Convex optimization; 90C30; 65K10; 90C25; 90C60 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10957-025-02713-5 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:206:y:2025:i:2:d:10.1007_s10957-025-02713-5

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-025-02713-5

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().