Partially observed optimal stopping problem for discrete-time Markov processes

Benoîte Saporta, François Dufour () and Christophe Nivot
Additional contact information
Benoîte Saporta: IMAG
François Dufour: INRIA
Christophe Nivot: INRIA

4OR, 2017, vol. 15, issue 3, No 3, 277-302

Abstract: Abstract This paper is dedicated to the investigation of a new numerical method to approximate the optimal stopping problem for a discrete-time continuous state space Markov chain under partial observations. It is based on a two-step discretization procedure based on optimal quantization. First, we discretize the state space of the unobserved variable by quantizing an underlying reference measure. Then we jointly discretize the resulting approximate filter and the observation process. We obtain a fully computable approximation of the value function with explicit error bounds for its convergence towards the true value function.

Keywords: Optimal stopping; Partial observations; Markov chain; Dynamic programming; Numerical approximation; Error bound; Quantization; 60J05; 60G40; 93E11 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s10288-016-0337-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:aqjoor:v:15:y:2017:i:3:d:10.1007_s10288-016-0337-8

Ordering information: This journal article can be ordered from
https://www.springer ... ch/journal/10288/PSE

DOI: 10.1007/s10288-016-0337-8

Access Statistics for this article

4OR is currently edited by Yves Crama, Michel Grabisch and Silvano Martello

More articles in 4OR from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().