An approximation approach to ergodic semi-Markov control processes

Anna Jaśkiewicz

Mathematical Methods of Operations Research, 2001, vol. 54, issue 1, 19 pages

Abstract: We consider semi-Markov control models (SMCMs) with a Borel state space satisfying certain stochastic stability assumptions on the transition structure which imply the so-called V-uniform geometric ergodicity of the state process. We deal with a class of ε-perturbations of transition probability functions of the original model. First, we determine the rate of convergence of the optimal expected costs in in perturbed models to the optimal expected cost in the orginal SMCM. Next, we present a new algorithm for finding the solution to the average cost optimality equation (ACOE). The algorithm makes use of a sequence of solutions to the ACOE for the perturbed models, which can be found by a simple iterative procedure. Copyright Springer-Verlag Berlin Heidelberg 2001

Keywords: Key words: Semi-Markov control models; Borel state space; average cost optimality equation (search for similar items in EconPapers)
Date: 2001
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://hdl.handle.net/10.1007/s001860000079 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:mathme:v:54:y:2001:i:1:p:1-19

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/00186

DOI: 10.1007/s001860000079

Access Statistics for this article

Mathematical Methods of Operations Research is currently edited by Oliver Stein

More articles in Mathematical Methods of Operations Research from Springer, Gesellschaft für Operations Research (GOR), Nederlands Genootschap voor Besliskunde (NGB)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().