Reinforcement Learning in Repeated Interaction Games

Jonathan Bendor (), Dilip Mookherjee and Debraj Ray

The B.E. Journal of Theoretical Economics, 2001, vol. 1, issue 1, 44

Abstract: We study long run implications of reinforcement learning when two players repeatedly interact with one another over multiple rounds to play a finite action game. Within each round, the players play the game many successive times with a fixed set of aspirations used to evaluate payoff experiences as successes or failures. The probability weight on successful actions is increased, while failures result in players trying alternative actions in subsequent rounds. The learning rule is supplemented by small amounts of inertia and random perturbations to the states of players. Aspirations are adjusted across successive rounds on the basis of the discrepancy between the average payoff and aspirations in the most recently concluded round. We define and characterize pure steady states of this model, and establish convergence to these under appropriate conditions. Pure steady states are shown to be individually rational, and are either Pareto-efficient or a protected Nash equilibrium of the stage game. Conversely, any Pareto-efficient and strictly individually rational action pair, or any strict protected Nash equilibrium, constitutes a pure steady state, to which the process converges from non-negligible sets of initial aspirations. Applications to games of coordination, cooperation, oligopoly, and electoral competition are discussed.

Keywords: reinforcement learning; aspirations; bounded rationality; cooperation; coordination (search for similar items in EconPapers)
Date: 2001
References: View complete reference list from CitEc
Citations: View citations in EconPapers (37)

Downloads: (external link)
https://doi.org/10.2202/1534-5963.1008 (text/html)
For access to full text, subscription to the journal or payment for the individual article is required.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:bejtec:v:advances.1:y:2001:i:1:n:3

Ordering information: This journal article can be ordered from
https://www.degruyter.com/journal/key/bejte/html

DOI: 10.2202/1534-5963.1008

Access Statistics for this article

The B.E. Journal of Theoretical Economics is currently edited by Burkhard C. Schipper

More articles in The B.E. Journal of Theoretical Economics from De Gruyter
Bibliographic data for series maintained by Peter Golla ().