The Role of Reinforcement Learning in the Emergence of Conventions: Simulation Experiments with the Repeated Volunteer’s Dilemma

Hendrik Nunner (), Wojtek Przepiorka and Chris Janssen ()
Additional contact information
Hendrik Nunner: https://www.imis.uni-luebeck.de/de/institut/team/hendrik-nunner
Chris Janssen: https://www.uu.nl/staff/cpjanssen

Journal of Artificial Societies and Social Simulation, 2022, vol. 25, issue 1, 7

Abstract: We use reinforcement learning models to investigate the role of cognitive mechanisms in the emergence of conventions in the repeated volunteer’s dilemma (VOD). The VOD is a multi-person, binary choice collective goods game in which the contribution of only one individual is necessary and sufficient to produce a benefit for the entire group. Behavioral experiments show that in the symmetric VOD, where all group members have the same costs of volunteering, a turn-taking convention emerges, whereas in the asymmetric VOD, where one “strong†group member has lower costs of volunteering, a solitary-volunteering convention emerges with the strong member volunteering most of the time. We compare three different classes of reinforcement learning models in their ability to replicate these empirical findings. Our results confirm that reinforcement learning models can provide a parsimonious account of how humans tacitly agree on one course of action when encountering each other repeatedly in the same interaction situation. We find that considering contextual clues (i.e., reward structures) for strategy design (i.e., sequences of actions) and strategy selection (i.e., favoring equal distribution of costs) facilitate coordination when optima are less salient. Furthermore, our models produce better fits with the empirical data when agents act myopically (favoring current over expected future rewards) and the rewards for adhering to conventions are not delayed.

Keywords: Conventions; Repeated Games; Volunteer’s Dilemma; Agent-Based Simulation; Reinforcement Learning; Cognitive Modeling (search for similar items in EconPapers)
Date: 2022-01-31
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.jasss.org/25/1/7/7.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2021-60-2

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().