Dynamic consistency for stochastic optimal control problems

Pierre Carpentier (), Jean-Philippe Chancelier (), Guy Cohen (), Michel Lara () and Pierre Girardeau ()

Annals of Operations Research, 2012, vol. 200, issue 1, 247-263

Abstract: For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step t 0 , the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time steps t 0 ,t 1 ,…,T; at the next time step t 1 , he is able to formulate a new optimization problem starting at time t 1 that yields a new sequence of optimal decision rules. This process can be continued until the final time T is reached. A family of optimization problems formulated in this way is said to be dynamically consistent if the optimal strategies obtained when solving the original problem remain optimal for all subsequent problems. The notion of dynamic consistency, well-known in the field of economics, has been recently introduced in the context of risk measures, notably by Artzner et al. (Ann. Oper. Res. 152(1):5–22, 2007 ) and studied in the stochastic programming framework by Shapiro (Oper. Res. Lett. 37(3):143–147, 2009 ) and for Markov Decision Processes (MDP) by Ruszczynski (Math. Program. 125(2):235–261, 2010 ). We here link this notion with the concept of “state variable” in MDP, and show that a significant class of dynamic optimization problems are dynamically consistent, provided that an adequate state variable is chosen. Copyright Springer Science+Business Media, LLC 2012

Keywords: Stochastic optimal control; Dynamic consistency; Dynamic programming; Risk measures (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://hdl.handle.net/10.1007/s10479-011-1027-8 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:annopr:v:200:y:2012:i:1:p:247-263:10.1007/s10479-011-1027-8

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10479

DOI: 10.1007/s10479-011-1027-8

Access Statistics for this article

Annals of Operations Research is currently edited by Endre Boros

More articles in Annals of Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().