EconPapers    
Economics at your fingertips  
 

Markovian Decision Processes with Probabilistic Observation of States

J. K. Satia and R. E. Lave
Additional contact information
J. K. Satia: Northeastern University
R. E. Lave: Stanford University

Management Science, 1973, vol. 20, issue 1, 1-13

Abstract: This is a study of finite state discrete time discounted Markovian decision process when the states are probabilistically observed. A model of this process is formulated, and an implicit enumeration algorithm is presented which optimizes the total expected discounted reward given the initial state. Several numerical examples are presented.

Date: 1973
References: Add references at CitEc
Citations: View citations in EconPapers (14)

Downloads: (external link)
http://dx.doi.org/10.1287/mnsc.20.1.1 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ormnsc:v:20:y:1973:i:1:p:1-13

Access Statistics for this article

More articles in Management Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().

 
Page updated 2025-04-17
Handle: RePEc:inm:ormnsc:v:20:y:1973:i:1:p:1-13