Memoryless Quasi-Newton Methods Based on the Spectral-Scaling Broyden Family for Riemannian Optimization

Yasushi Narushima (), Shummin Nakayama (), Masashi Takemura () and Hiroshi Yabe ()
Additional contact information
Yasushi Narushima: Keio University
Shummin Nakayama: The University of Electro-Communications
Masashi Takemura: Lattice Technology Co., Ltd.
Hiroshi Yabe: Tokyo University of Science

Journal of Optimization Theory and Applications, 2023, vol. 197, issue 2, No 9, 639-664

Abstract: Abstract We consider iterative methods for unconstrained optimization on Riemannian manifolds. Though memoryless quasi-Newton methods are effective for large-scale unconstrained optimization in the Euclidean space, they have not been studied over Riemannian manifolds. Therefore, in this paper, we propose a memoryless quasi-Newton method in Riemannian manifolds. The proposed method is based on the spectral-scaling Broyden family with additional modifications to ensure the sufficient descent condition. We present an algorithm for the proposed method that uses the Wolfe line search conditions and show that this algorithm guarantees global convergence. We emphasize that global convergence is guaranteed without any assumptions regarding the convexity of the objective function or the isometric property of the vector transport. In addition, we derive appropriate selections for the parameter vector contained in the proposed method. Numerical experiments are conducted to compare the proposed method with conventional conjugate gradient methods using typical test problems. The results show that the proposed method is superior to the tested conjugate gradient methods.

Keywords: Riemannian optimization; Memoryless quasi-Newton methods; Broyden family; Global convergence; 65K05; 90C48; 90C53 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10957-023-02183-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:197:y:2023:i:2:d:10.1007_s10957-023-02183-7

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-023-02183-7

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().