Single-Controller Chance-Constrained Stochastic Games

Ayush Verma (), Vikas Vikram Singh () and Abdel Lisser ()
Additional contact information
Ayush Verma: Indian Institute of Technology Delhi
Vikas Vikram Singh: Indian Institute of Technology Delhi
Abdel Lisser: Universite Paris Saclay

Journal of Optimization Theory and Applications, 2025, vol. 207, issue 1, No 15, 21 pages

Abstract: Abstract Strategic decision-making problems involving multiple players competing over an infinite horizon have been extensively studied in the literature using a stochastic game framework. It assumes that the model parameters, namely, running costs and transition probabilities are exactly known by ignoring the fact that, in reality, these parameters are estimated or learned from historical data. In this paper, we consider a two-player single-controller discounted stochastic game where the dynamics defined by transition probabilities of a Markov chain depends only on the actions of player 2. We consider the case where the running costs are defined by the random variables and the transition probabilities are exactly known. The players are risk-averse and are interested in expected discounted costs incurred with a given confidence level. To model this game theoretic situation, we formulate the expected discounted costs using chance constraints and call the game a single-controller chance-constrained stochastic game. When the running cost vector of each player follows a multivariate elliptically symmetric distribution, we show that there exists a Nash equilibrium in the class of stationary strategies. To compute the Nash equilibria, we propose an equivalent mathematical program and a system of nonlinear constraints whose global maximum and feasible solution, respectively, give a Nash equilibrium of the game. We illustrate our theoretical results by considering randomly generated instances.

Keywords: Stochastic games; Chance constraint; Mathematical program; 91A15; 90C15; 90C30 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10957-025-02767-5 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:joptap:v:207:y:2025:i:1:d:10.1007_s10957-025-02767-5

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10957/PS2

DOI: 10.1007/s10957-025-02767-5

Access Statistics for this article

Journal of Optimization Theory and Applications is currently edited by Franco Giannessi and David G. Hull

More articles in Journal of Optimization Theory and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().