Markov chains with replacement

E. Arjas and T. P. Speed

Stochastic Processes and their Applications, 1975, vol. 3, issue 2, 175-184

Abstract: The following modification of a general state space discrete-time Markov chain is considered: certain transitions are supposed "forbidden" and the chain evolves until there is such a transition. At this instant the value of the chain is "replaced" according to a given rule, and, starting from the new value, the chain evolves normally until there is a forbidden transition again; the cycle is then repeated. The relationship of this modified process to the original one is studied in general terms, with particular emphasis being given to invariant measures. Examples are given which illustrate the results obtained.

Keywords: Markov; Chain; replacement; invariant; measure; general; state; space; forbidden; transition (search for similar items in EconPapers)
Date: 1975
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/0304-4149(75)90014-9
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:spapps:v:3:y:1975:i:2:p:175-184

Ordering information: This journal article can be ordered from
http://http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Stochastic Processes and their Applications is currently edited by T. Mikosch

More articles in Stochastic Processes and their Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().