Reinforcement Learning in Repeated Interaction Games

Jonathan Bendor, Dilip Mookherjee and Debraj Ray ()
Additional contact information
Jonathan Bendor: Stanford University
Dilip Mookherjee: Boston University

The B.E. Journal of Theoretical Economics, 2001, vol. advances.1, issue 1

Abstract: We study long run implications of reinforcement learning when two players repeatedly interact with one another over multiple rounds to play a finite action game. Within each round, the players play the game many successive times with a fixed set of aspirations used to evaluate payoff experiences as successes or failures. The probability weight on successful actions is increased, while failures result in players trying alternative actions in subsequent rounds. The learning rule is supplemented by small amounts of inertia and random perturbations to the states of players. Aspirations are adjusted across successive rounds on the basis of the discrepancy between the average payoff and aspirations in the most recently concluded round. We define and characterize pure steady states of this model, and establish convergence to these under appropriate conditions. Pure steady states are shown to be individually rational, and are either Pareto-efficient or a protected Nash equilibrium of the stage game. Conversely, any Pareto-efficient and strictly individually rational action pair, or any strict protected Nash equilibrium, constitutes a pure steady state, to which the process converges from non-negligible sets of initial aspirations. Applications to games of coordination, cooperation, oligopoly, and electoral competition are discussed.

Keywords: reinforcement learning; aspirations; bounded rationality; cooperation; coordination (search for similar items in EconPapers)
JEL-codes: C7 D7 (search for similar items in EconPapers)
Date: 2001

Downloads: (external link)
http://www.bepress.com/cgi/viewcontent.cgi?article=1008&context=bejte (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:bpj:bejtec:v:advances.1:y:2001:i:1:n:3

Access Statistics for this article

More articles in The B.E. Journal of Theoretical Economics from Berkeley Electronic Press
Series data maintained by Avi Warner ().