Periodically homogeneous Markov chains: The discrete state space case

Abdelhakim Aknouche

MPRA Paper from University Library of Munich, Germany

Abstract: state spaces with periodically time-varying transition probabilities is introduced. The finite-dimensional probability distributions of these time-periodic chains are first studied and their correspondence with the marginal distributions and transition probabilities is shown. Then, the concepts of periodic stability/regularity and limiting behaviors are proposed. The communicability and classification of states necessary for establishing periodic stability are then examined. In particular, periodic irreducibility and the main solidarity/class properties are presented, namely periodic recurrence, periodic positive recurrence, periodic transience, and periodic aperiodicity. Furthermore, sufficient conditions for periodic stochastic stability of time-periodic Markov chains are derived. Finally, various applications to some operations research models and time series analysis are considered. In particular, periodic Markov decision processes, periodic integer-valued time series models, and periodic Markov-switching time series models are examined.

Keywords: Time-periodic Markov chains; Harris periodic ergodicity; periodic irreducibility; periodic recurrence; periodic stability; periodic invariant distributions; periodic integer-valued time series models; Markov-switching periodic models; periodic Markov decision process. (search for similar items in EconPapers)
JEL-codes: C01 C02 C30 (search for similar items in EconPapers)
Date: 2024-10-04
New Economics Papers: this item is included in nep-ecm and nep-ets
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/122287/1/MPRA_paper_122287.pdf original version (application/pdf)
https://mpra.ub.uni-muenchen.de/122297/1/MPRA_paper_122297.pdf revised version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:122287

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().