On the construction of quadratic models for derivative-free trust-region algorithms

Adriano Verdério (), Elizabeth W. Karas, Lucas G. Pedroso and Katya Scheinberg
Additional contact information
Adriano Verdério: Federal University of Technology - Paraná
Elizabeth W. Karas: Federal University of Paraná
Lucas G. Pedroso: Federal University of Paraná
Katya Scheinberg: Lehigh University

EURO Journal on Computational Optimization, 2017, vol. 5, issue 4, No 4, 527 pages

Abstract: Abstract We consider derivative-free trust-region algorithms based on sampling approaches for convex constrained problems and discuss two conditions on the quadratic models for ensuring their global convergence. The first condition requires the poisedness of the sample sets, as usual in this context, while the other one is related to the error between the model and the objective function at the sample points. Although the second condition trivially holds if the model is constructed by polynomial interpolation, since in this case the model coincides with the objective function at the sample set, we show that it also holds for models constructed by support vector regression. These two conditions imply that the error between the gradient of the trust-region model and the objective function is of the order of $$\delta _k$$ δ k , where $$\delta _k$$ δ k controls the diameter of the sample set. This allows proving the global convergence of a trust-region algorithm that uses two radii, $$\delta _k$$ δ k and the trust-region radius. Preliminary numerical experiments are presented for minimizing functions with and without noise.

Keywords: Derivative-free optimization; Trust region; Polynomial interpolation; Support vector regression; 90C56; 65K05; 49M37 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://link.springer.com/10.1007/s13675-017-0081-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:eurjco:v:5:y:2017:i:4:d:10.1007_s13675-017-0081-7

Ordering information: This journal article can be ordered from
http://www.springer. ... search/journal/13675

DOI: 10.1007/s13675-017-0081-7

Access Statistics for this article

EURO Journal on Computational Optimization is currently edited by Martine C. Labbé

More articles in EURO Journal on Computational Optimization from Springer, EURO - The Association of European Operational Research Societies
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().