An Evaluation of Substitute Methods for Derivatives in Unconstrained Optimization

D. M. Himmelblau and J. W. Lindsay
Additional contact information
D. M. Himmelblau: University of Texas, Austin, Texas
J. W. Lindsay: University of Texas, Austin, Texas

Operations Research, 1980, vol. 28, issue 3-part-ii, 668-686

Abstract: Under what circumstances can finite difference approximations serve as substitutes for analytical derivatives in unconstrained optimization? Are such techniques as good as using derivative-free methods? We investigated these two questions via both theoretical analysis and the solution of 15 test problems on the computer. It was discovered as expected that the error in the derivative substitutes influences algorithm performance only near termination, and that simple difference formulas are more efficient than more complex ones if the step size is selected properly. Among all the algorithms tested, the Davidon algorithm was the best both for the class using analytical derivatives and for the class with finite difference substitutes. Derivative-free algorithms were not as efficient.

Date: 1980
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/opre.28.3.668 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:28:y:1980:i:3-part-ii:p:668-686

Access Statistics for this article

More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().