Controlled Markov Chains with Utility Functions

Seiichi Iwamoto (), Takayuki Ueno () and Toshiharu Fujita ()
Additional contact information
Seiichi Iwamoto: Graduate School of Economics Kyushu University 27, Department of Economic Engineering
Takayuki Ueno: Graduate School of Economics Kyushu University 27, Department of Economic Engineering
Toshiharu Fujita: Kyushu Institute of Technology, Department of Electric, Electronic and Computer Engineering

Chapter Chapter 8 in Markov Processes and Controlled Markov Chains, 2002, pp 135-149 from Springer

Abstract: Abstract In this paper we consider finite-stage stochastic optimization problems of utility criterion, which is the stochastic evaluation of associative reward through a utility function. We optimize the expected value of a utility criterion not in the class of Markov policies but in the class of general policies. We show that, by expanding the state space, an invariant imbedding approach yields an recursive relation between two adjacent optimal value functions. We show that the utility problem with a general policy is equivalent to a terminal problem with a Markov policy on the augmented state space. Finally it is shown that the utility problem has an optimal policy in the class of general policies on the original state space.

Keywords: Utility Function; Optimal Policy; Markov Decision Process; Reward Function; General Policy (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-1-4613-0265-0_8

Ordering information: This item can be ordered from
http://www.springer.com/9781461302650

DOI: 10.1007/978-1-4613-0265-0_8

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().