Beyond cyclic dominance: Reinforcement learning promotes cooperation in the spatial rock–paper–scissors game

Zehua Si and Takayuki Ito

Chaos, Solitons & Fractals, 2025, vol. 199, issue P1

Abstract: Cyclic dominance is widely recognized as a fundamental mechanism for sustaining cooperation in structured populations. However, existing studies primarily employ strategy updating mechanisms based on imitation, neglecting the role of individual learning from experience. In this study, we investigate the spatial rock–paper–scissors game with destructive agents on a two-dimensional lattice network, incorporating reinforcement learning as the strategy updating mechanism. Specifically, we examine two distinct learning paradigms: self-regarding Q-learning, where individuals update their strategies based solely on personal experience, and neighbor-regarding Q-learning, which integrates both individual and neighbor experiences. Monte Carlo simulation results demonstrate that when Q-learning governs strategy updates, cyclic dominance disappears, leading the system to converge toward a single dominant strategy. The specific dominant strategy depends on the adopted learning paradigm: when individuals rely exclusively on their own experiences, destructive agents ultimately dominate the system. In contrast, when individuals incorporate experiences from their neighbors, full cooperation emerges. These findings suggest that the significance of cyclic dominance in promoting cooperation may have been overestimated. Instead, cooperation can be maintained through experiential learning, as long as the learning perspective is not overly constrained.

Keywords: Evolution of cooperation; Rock–paper–scissors game; Destructive agents; Q-learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925006411
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:199:y:2025:i:p1:s0960077925006411

DOI: 10.1016/j.chaos.2025.116628

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().