Generalization of White's Method of Successive Approximations to Periodic Markovian Decision Processes

Shiaw Y. Su and Rolf A. Deininger
Additional contact information
Shiaw Y. Su: Sun Oil Company, Dallas, Texas
Rolf A. Deininger: The University of Michigan, Ann Arbor, Michigan

Operations Research, 1972, vol. 20, issue 2, 318-326

Abstract: The difficulty in solving a Markovian decision problem with a large number of states by Howard's policy-iteration method is that one has to solve a large system of simultaneous linear equations. Procedures developed by D. J. White and J. MacQueen, which avoid this difficulty, have been widely used to handle large-scale Markovian decision problems. This paper extends these algorithms to the case where the Markovian decision process is periodic. Proofs of the convergence of these new algorithms are sketched. Some computational experiences based on the modeling of the Great Lakes regulation systems are also given.

Date: 1972
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/opre.20.2.318 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:20:y:1972:i:2:p:318-326

Access Statistics for this article

More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().