Multitime Dynamic Programming for Curvilinear Integral Actions

C. Udrişte () and I. Ţevy ()
Additional contact information
C. Udrişte: University Politehnica of Bucharest
I. Ţevy: University Politehnica of Bucharest

Journal of Optimization Theory and Applications, 2010, vol. 146, issue 1, No 12, 189-207

Abstract: Abstract This paper justifies dynamic programming PDEs for optimal control problems with performance criteria involving curvilinear integrals. The main novel feature, relative to the known theory, is that the multitime dynamic programming PDEs are now connected to the multitime maximum principle. For the first time, an interesting and useful connection between the multitime maximum principle and the multitime dynamic programming is given, characterizing the optimal control by means of a PDE system that may be viewed as a multitime feedback law. Section 1 describes the roots of our point of view regarding the multitime Hamilton-Jacobi-Bellman PDEs. Section 2 recalls the multitime maximum principle formulated for an optimal control problem with a cost functional including a curvilinear integral and introduces the notion of multitime maximum value function. Section 3 shows how a multitime control dynamics and the multitime maximum value function determine the multitime Hamilton-Jacobi-Bellman PDEs. Section 4 describes how the multitime dynamic programming method can be used in the design of multitime optimal controls. Section 5 shows that the multitime Hamilton PDEs are characteristic equations for the multitime Hamilton-Jacobi-Bellman PDEs and reveals the connection between multitime dynamic programming and the multitime maximum principle.

Keywords: Maximum value function; Multitime Hamilton-Jacobi-Bellman PDEs; Multitime dynamic programming; Multitime maximum principle (search for similar items in EconPapers)
Date: 2010
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://link.springer.com/10.1007/s10957-010-9664-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:146:y:2010:i:1:d:10.1007_s10957-010-9664-7

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-010-9664-7

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().