Equations for the Missing Boundary Values in the Hamiltonian Formulation of Optimal Control Problems

Vicente Costanza (), Pablo S. Rivadeneira and Ruben D. Spies
Additional contact information
Vicente Costanza: CONICET-UNL
Pablo S. Rivadeneira: CONICET-UNL
Ruben D. Spies: CONICET-UNL

Journal of Optimization Theory and Applications, 2011, vol. 149, issue 1, No 2, 26-46

Abstract: Abstract Partial differential equations for the unknown final state and initial costate arising in the Hamiltonian formulation of regular optimal control problems with a quadratic final penalty are found. It is shown that the missing boundary conditions for Hamilton’s canonical ordinary differential equations satisfy a system of first-order quasilinear vector partial differential equations (PDEs), when the functional dependence of the H-optimal control in phase-space variables is explicitly known. Their solutions are computed in the context of nonlinear systems with ℝ n -valued states. No special restrictions are imposed on the form of the Lagrangian cost term. Having calculated the initial values of the costates, the optimal control can then be constructed from on-line integration of the corresponding 2n-dimensional Hamilton ordinary differential equations (ODEs). The off-line procedure requires finding two auxiliary n×n matrices that generalize those appearing in the solution of the differential Riccati equation (DRE) associated with the linear-quadratic regulator (LQR) problem. In all equations, the independent variables are the finite time-horizon duration T and the final-penalty matrix coefficient S, so their solutions give information on a whole two-parameter family of control problems, which can be used for design purposes. The mathematical treatment takes advantage from the symplectic structure of the Hamiltonian formalism, which allows one to reformulate Bellman’s conjectures concerning the “invariant-embedding” methodology for two-point boundary-value problems. Results for LQR problems are tested against solutions of the associated differential Riccati equation, and the attributes of the two approaches are illustrated and discussed. Also, nonlinear problems are numerically solved and compared against those obtained by using shooting techniques.

Keywords: Optimal control; Hamilton equations; First order PDEs; Boundary-value problems; Riccati equations (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10957-010-9773-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:149:y:2011:i:1:d:10.1007_s10957-010-9773-3

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-010-9773-3

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().