A New Optimality Criterion for Nonhomogeneous Markov Decision Processes
Wallace J. Hopp,
James C. Bean and
Robert L. Smith
Additional contact information
Wallace J. Hopp: Northwestern University, Evanston, Illinois
James C. Bean: The University of Michigan, Ann Arbor, Michigan
Robert L. Smith: The University of Michigan, Ann Arbor, Michigan
Operations Research, 1987, vol. 35, issue 6, 875-883
Abstract:
We propose a new definition of optimality for nonhomogeneous Markov decision processes called periodic forecast horizon (PFH) optimality. Using measures of discounting and ergodicity, we establish conditions under which PFH-optimal strategies exist and PFH optimality implies the more conventional notions of α-optimality and average optimality. Finally, we use this definition of optimality as the basis for a direct development of forecast horizon results for discounted and undiscounted nonhomogeneous Markov decision processes.
Keywords: 118 computations for nonhomogeneous chains; 626 new optimality criterion (search for similar items in EconPapers)
Date: 1987
References: Add references at CitEc
Citations: View citations in EconPapers (12)
Downloads: (external link)
http://dx.doi.org/10.1287/opre.35.6.875 (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:inm:oropre:v:35:y:1987:i:6:p:875-883
Access Statistics for this article
More articles in Operations Research from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().