An Approximated Solution to Continuous-Time Stochastic Optimal Control Problems Through Markov Decision Chains

Jacek Krawczyk () and Alistair Windsor
Additional contact information
Alistair Windsor: Victoria University of Wellington

Computational Economics from University Library of Munich, Germany

Abstract: Strategies for constructing a Markov decision chain approximating a continuous-time finite-horizon optimal control problem are investigated. Some simple, analytically soluble, examples are treated and low computational complexity is reported. Extensions to the method and implementation are discussed. In particular, relevance of the approximated solution to a stochastic renewable resource valuation problem is examined.

Keywords: Approximating Markov decision chains; simple noise discretisation. Natural resource valuation. (search for similar items in EconPapers)
JEL-codes: C63 C8 D92 Q25 (search for similar items in EconPapers)
Pages: 38 pages
Date: 1997-10-01
Note: Type of Document - LaTeX; prepared on UNIX; to print on PostScript; pages: 38 ; figures: included
References: Add references at CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.ps.gz (application/postscript)
https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.pdf (application/pdf)
https://econwpa.ub.uni-muenchen.de/econ-wp/comp/papers/9710/9710001.zip (application/zip)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wpa:wuwpco:9710001

Access Statistics for this paper

More papers in Computational Economics from University Library of Munich, Germany
Bibliographic data for series maintained by EconWPA ( this e-mail address is bad, please contact ).