Optimality Conditions for CTMDP with Average Cost Criterion

Xianping Guo () and Weiping Zhu ()
Additional contact information
Xianping Guo: Zhongshan University, Department of Mathematics
Weiping Zhu: The University of Queensland, Department of Computer Science and Electrical Engineering

Chapter Chapter 10 in Markov Processes and Controlled Markov Chains, 2002, pp 167-188 from Springer

Abstract: Abstract In this paper, we consider continuous time Markov decision processes with (possibly unbounded) transition and cost rates under the average cost criterion. We present a set of conditions that is weaker than those in [5, 11, 12, 14], and prove the existence of optimal stationary policies using the optimality inequality. Moreover, the theory is illustrated by two examples.

Keywords: Continuous Time Markov Decision Processes (CTMDPs); Average Cost Criterion; Optimality Inequality (OIE); Optimal Stationary Policies (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-1-4613-0265-0_10

Ordering information: This item can be ordered from
http://www.springer.com/9781461302650

DOI: 10.1007/978-1-4613-0265-0_10

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().