Introduction

Wai-Ki Ching, Ximin Huang, Michael K. Ng and Tak Kuen Siu
Additional contact information
Wai-Ki Ching: The University of Hong Kong
Ximin Huang: Georgia Institute of Technology
Michael K. Ng: Hong Kong Baptist University

Chapter Chapter 1 in Markov Chains, 2013, pp 1-46 from Springer

Abstract: Abstract Markov chains are named after Prof. Andrei A. Markov (1856–1922). He was born on June 14, 1856 in Ryazan, Russia and died on July 20, 1922 in St. Petersburg, Russia. Markov enrolled at the University of St. Petersburg, where he earned a master’s degree and a doctorate degree. He was a professor at St. Petersburg and also a member of the Russian Academy of Sciences.

Keywords: Markov Chain; Conjugate Gradient Method; Markov Decision Process; Hide State; Markov Chain Model (search for similar items in EconPapers)
Date: 2013
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:isochp:978-1-4614-6312-2_1

Ordering information: This item can be ordered from
http://www.springer.com/9781461463122

DOI: 10.1007/978-1-4614-6312-2_1

Access Statistics for this chapter

More chapters in International Series in Operations Research & Management Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().