Convergence of Inexact Quasisubgradient Methods with Extrapolation

Xiaoqi Yang () and Chenchen Zu ()
Additional contact information
Xiaoqi Yang: The Hong Kong Polytechnic University
Chenchen Zu: The Hong Kong Polytechnic University

Journal of Optimization Theory and Applications, 2022, vol. 193, issue 1, No 29, 676-703

Abstract: Abstract In this paper, we investigate an inexact quasisubgradient method with extrapolation for solving a quasiconvex optimization problem with a closed, convex and bounded constraint set. We establish the convergence in objective values, iteration complexity and rate of convergence for our proposed method under Hölder condition and weak sharp minima condition. When both diminishing stepsize and extrapolation stepsize are decaying as a power function, we obtain explicit iteration complexities. When diminishing stepsize is decaying as a power function and the extrapolation stepsize is decreasing not less than a power function, the diminishing stepsize provides a rate of convergence $${\mathcal {O}}\left( \tau ^{k^{s}}\right) (s \in (0,1))$$ O τ k s ( s ∈ ( 0 , 1 ) ) to an optimal solution or to a ball of the optimal solution set, which is faster than $${\mathcal {O}}\left( {1}/{k^\beta }\right) $$ O 1 / k β (for each $$\beta >0$$ β > 0 ). With geometrically decreasing extrapolation stepsize, we obtain a linear rate of convergence to a ball of the optimal solution set for the constant stepsize and dynamic stepsize. Our numerical testing shows that the performance with extrapolation is much more efficient than that without extrapolation in terms of the number of iterations needed for reaching an approximate optimal solution.

Keywords: Quasiconvex; Quasisubgradient; Iteration complexity; Rate of convergence; Extrapolation; 65K05; 90C26; 49M37 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s10957-022-02014-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:193:y:2022:i:1:d:10.1007_s10957-022-02014-1

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-022-02014-1

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().