Risk-Sensitive Optimal Control in Communicating Average Markov Decision Chains

Rolando Cavazos-Cadena and Emmanuel Fernández-Gaucherand ()
Additional contact information
Rolando Cavazos-Cadena: UniversidadAutónoma Agraria Antonio Narro
Emmanuel Fernández-Gaucherand: University of Cincinnati

Chapter Chapter 22 in Modeling Uncertainty, 2002, pp 515-553 from Springer

Abstract: Abstract This work concerns discrete-time Markov decision processes with denumerable state space and bounded costs per stage. The performance of a control policy is measured by a (long-run) risk-sensitive average cost criterion associated to a utility function with constant risk sensitivity coefficient λ, and the main objective of the paper is to study the existence of bounded solutions to the risk-sensitive average cost optimality equation for arbitrary values of λ. The main results are as follows: When the state space is finite, if the transition law is communicating, in the sense that under an arbitrary stationary policy transitions are possible between every pair of states, the optimality equation has a bounded solution for arbitrary non-null λ. However, when the state space is infinite and denumerable, the communication requirement and a strong form of the simultaneous Doeblin condition do not yield a bounded solution to the optimality equation if the risk sensitivity coefficie nt has a sufficiently large absolute value, in general.

Keywords: Markov decision proccesses; Exponential utility function; Constant risk sensitivity; Constant average cost; Communication condition; Simultaneous Doeblin condition; Bounded solutions to the risk-sensitive optimality equation (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:isochp:978-0-306-48102-4_22

Ordering information: This item can be ordered from
http://www.springer.com/9780306481024

DOI: 10.1007/0-306-48102-2_22

Access Statistics for this chapter

More chapters in International Series in Operations Research & Management Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().