Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity

Selene Chávez-Rodríguez (), Rolando Cavazos-Cadena () and Hugo Cruz-Suárez ()

Mathematical Methods of Operations Research, 2015, vol. 81, issue 3, 269-298

Abstract: This note concerns discrete-time controlled Markov chains driven by a decision maker with constant risk-sensitivity $$\lambda $$ λ . Assuming that the system evolves on a denumerable state space and is endowed with a bounded cost function, the paper analyzes the continuity of the optimal average cost with respect to the risk-sensitivity parameter, a property that is promptly seen to be valid at each no-null value of $$\lambda $$ λ . Under standard continuity-compactness conditions, it is shown that a general form of the simultaneous Doeblin condition allows to establish the continuity of the optimal average cost at $$\lambda=0$$ λ = 0 , and explicit examples are given to show that, even if every state is positive recurrent under the action of any stationary policy, the above continuity conclusion can not be ensured under weaker recurrence requirements, as the Lyapunov function condition. Copyright Springer-Verlag Berlin Heidelberg 2015

Keywords: Risk-sensitive optimality equation; Discounted approach; Uniformly bounded solutions to the optimality equation; Jensen’s inequality; Stopping times; Transient states; Continuity at risk-neutrality; 93E20; 60J05; 93C55 (search for similar items in EconPapers)
Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1007/s00186-015-0496-y (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:mathme:v:81:y:2015:i:3:p:269-298

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/00186

DOI: 10.1007/s00186-015-0496-y

Access Statistics for this article

Mathematical Methods of Operations Research is currently edited by Oliver Stein

More articles in Mathematical Methods of Operations Research from Springer, Gesellschaft für Operations Research (GOR), Nederlands Genootschap voor Besliskunde (NGB)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().