Evolution of cooperation in the public goods game with Q-learning

Guozhong Zheng, Jiqiang Zhang, Shengfeng Deng, Weiran Cai and Li Chen

Chaos, Solitons & Fractals, 2024, vol. 188, issue C

Abstract: Recent paradigm shifts from imitation learning to reinforcement learning (RL) is shown to be productive in understanding human behaviors. In the RL paradigm, individuals search for optimal strategies through interaction with the environment to make decisions. This implies that gathering, processing, and utilizing information from their surroundings is crucial. However, existing studies on public good games using the Q-learning algorithm typically adopt a self-regarding setup, where individuals adjust their strategies based solely on their own strategic information, neglecting the environmental factors. In this work, we investigate the evolution of cooperation with the multiplayer game — the public goods game using the Q-learning algorithm by leveraging the environmental information. Specifically, the decision-making of players is based on the cooperation information in their neighborhood. Our results show that cooperation is more likely to emerge compared to the case of imitation learning by using Fermi-function-based update rule. Of particular interest is the observation of an anomalous non-monotonic dependence which is revealed when voluntary participation is further introduced. The analysis of the Q-table explains the mechanisms behind the cooperation evolution. Our findings indicate the fundamental role of environment information in the RL paradigm to understand the evolution of cooperation, and human behaviors in general.

Keywords: Cooperation; Public goods game; Reinforcement learning; Evolutionary dynamics (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077924011202
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:188:y:2024:i:c:s0960077924011202

DOI: 10.1016/j.chaos.2024.115568

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().