Discussion of dynamic programming and linear programming approaches to stochastic control and optimal stopping in continuous time

R. Stockbridge ()

Metrika: International Journal for Theoretical and Applied Statistics, 2014, vol. 77, issue 1, 137-162

Abstract: This paper seeks to highlight two approaches to the solution of stochastic control and optimal stopping problems in continuous time. Each approach transforms the stochastic problem into a deterministic problem. Dynamic programming is a well-established technique that obtains a partial/ordinary differential equation, variational or quasi-variational inequality depending on the type of problem; the solution provides the value of the problem as a function of the initial position (the value function). The other method recasts the problems as linear programs over a space of feasible measures. Both approaches use Dynkin’s formula in essential but different ways. The aim of this paper is to present the main ideas underlying these approaches with only passing attention paid to the important and necessary technical details. Copyright Springer-Verlag Berlin Heidelberg 2014

Keywords: Stochastic control; Optimal stopping; Dynamic programming; Linear programming; HJB equation (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1007/s00184-013-0476-2 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metrik:v:77:y:2014:i:1:p:137-162

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/184/PS2

DOI: 10.1007/s00184-013-0476-2

Access Statistics for this article

Metrika: International Journal for Theoretical and Applied Statistics is currently edited by U. Kamps and Norbert Henze

More articles in Metrika: International Journal for Theoretical and Applied Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().