Markov chains with transition delta-matrix: ergodicity conditions, invariant probability measures and applications

Lev Abolnikov and Alexander Dukhovny

International Journal of Stochastic Analysis, 1991, vol. 4, 1-23

Abstract:

A large class of Markov chains with so-called Δ m , n -and Δ ′ m , n -transition matrices (delta-matrices) which frequently occur in applications (queues, inventories, dams) is analyzed.

The authors find some structural properties of both types of Markov chains and develop a simple test for their irreducibility and aperiodicity. Necessary and sufficient conditions for the ergodicity of both chains are found in the article in two equivalent versions. According to one of them, these conditions are expressed in terms of certain restrictions imposed on the generating functions A i ( z ) of the elements of the i th row of the transition matrix, i = 0 , 1 , 2 , … ; in the other version they are connected with the characterization of the roots of a certain associated function in the unit disc of the complex plane. The invariant probability measures of Markov chains of both kinds are found in terms of generating functions. It is shown that the general method in some important special cases can be simplified and yields convenient and, sometimes, explicit results.

As examples, several queueing and inventory (dam) models, each of independent interest, are analyzed with the help of the general methods developed in the article.

Date: 1991
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://downloads.hindawi.com/journals/IJSA/4/806707.pdf (application/pdf)
http://downloads.hindawi.com/journals/IJSA/4/806707.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnijsa:806707

DOI: 10.1155/S1048953391000254

Access Statistics for this article

More articles in International Journal of Stochastic Analysis from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().