Markov Chains

Sidney I. Resnick
Additional contact information
Sidney I. Resnick: Cornell University, School of Operations Research and Industrial Engineering

Chapter Chapter 2 in Adventures in Stochastic Processes, 2002, pp 60-173 from Springer

Abstract: Abstract Intrying to make a realistic stochastic model of any physical situation, one is forced to confront the fact that real life is full of dependencies. For example, purchases next week at the supermarket may depend on satisfaction with purchases made up to now. Similarly, an hourly reading of pollution concentration at a fixed monitoring station will depend on previous readings; tomorrow’s stock inventory will depend on the stock level today, as well as on demand. The number of customers awaiting service at a facility depends on the number of waiting customers in previous time periods.

Keywords: Markov Chain; State Space; Stationary Distribution; Invariant Measure; Transition Matrix (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-1-4612-0387-2_2

Ordering information: This item can be ordered from
http://www.springer.com/9781461203872

DOI: 10.1007/978-1-4612-0387-2_2

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().