Stochastic Games and Positional Games on Networks

Dmitrii Lozovanu and Stefan Wolfgang Pickl
Additional contact information
Dmitrii Lozovanu: Moldowa Academy of Science
Stefan Wolfgang Pickl: Universität der Bundeswehr München

Chapter Chapter 3 in Markov Decision Processes and Stochastic Positional Games, 2024, pp 245-382 from Springer

Abstract: Abstract Stochastic games represent an important class of models in game theory that extend Markov decision processes to competitive situations with more than one decision-maker. Such models may be with finite, countable, or continuum cardinality sets of states Kallenberg ((2011) Markov decision processes. Lecture Notes. University of Leiden, pp 2–5), Puterman ((2014) Markov decision processes: discrete stochastic dynamic programming. Wiley). In this chapter, we consider only stochastic games with finite state and action spaces. We mainly study two classes of games: stochastic games with average payoff optimization criteria and stochastic games with discounted payoff optimization criteria for the players. The main results presented in this chapter are concerned with the existence and determination of stationary Nash equilibria for different classes of stochastic games. By applying the concept of positional games for the Markov decision problems and stochastic control on networks, we formulate a class of stochastic positional games for which Nash equilibria in stationary strategies exist and for which efficient algorithms to determine the optimal stationary strategies of the players can be elaborated.

Keywords: Stochastic games; Average stochastic game; Discounted stochastic game; Stochastic positional game; Nash equilibrium; Stationary equilibrium; Non-stationary equilibrium; Positional games on networks (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:isochp:978-3-031-40180-0_3

Ordering information: This item can be ordered from
http://www.springer.com/9783031401800

DOI: 10.1007/978-3-031-40180-0_3

Access Statistics for this chapter

More chapters in International Series in Operations Research & Management Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().