Gradient Extremals, Talwegs, Valleys, and Directional Alignment for Generic Gradient Descent
Pascal Bégout,
Jérôme Bolte,
Thomas Mariotti and
Francisco José Silva - Àlvarez
No 26-1735, TSE Working Papers from Toulouse School of Economics (TSE)
Abstract:
Gradient extremals are loci along which the gradient is an eigenvector of the Hessian. These objects provide a natural geometric framework connecting several notions, notably valleys and talwegs, which we analyze from a variational viewpoint in the generic case. We then show that trajectories of the gradient flow and of its discrete counterpart exhibit directional alignment with the tangent spaces to gradient extremals, and generically to the talweg. Under non-resonance assumptions, and in contrast with the quadratic case, alignment rates are governed either by the first spectral gap or by the smallest eigenvalue of the Hessian at the limit point. Nonlinearities and the step length may both distort these rates in a complex manner. We further prove a volume concentration phenomenon emphasizing the structuring role of gradient extremals: for large times, the images of sets of initial conditions concentrate inside valleys and asymptotically around talwegs.
Date: 2026-04
References: Add references at CitEc
Citations:
Downloads: (external link)
https://www.tse-fr.eu/sites/default/files/TSE/docu ... 2026/wp_tse_1735.pdf Working paper (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:tse:wpaper:131677
Access Statistics for this paper
More papers in TSE Working Papers from Toulouse School of Economics (TSE) Contact information at EDIRC.
Bibliographic data for series maintained by ().