Learning and propagation: Evolutionary dynamics in spatial public goods games through combined Q-learning and Fermi rule

Yong Shen, Yujie Ma, Hongwei Kang, Xingping Sun and Qingyi Chen

Chaos, Solitons & Fractals, 2024, vol. 187, issue C

Abstract: Propagation is crucial for acquiring information, and learning involves deep information processing. Imitation dynamics, commonly used in spatial public goods games, represents strategy propagation in society, while learning dynamics enables agents to self-learn through environmental interactions. In this paper, Q-learning and the Fermi update rule are used to compare differences between learning dynamics and imitation dynamics in simulation experiments. Our study finds that Q-learning is continuously updating the Q-table during its evolution, forming a heterogeneous gain matrix. However, Q-learning’s interaction with the environment is indirect, with almost no network reciprocity, and cannot form clusters in contrast to the Fermi update rule. The Fermi update rule focus only on immediate payoffs. Furthermore, we combine imitation dynamics and learning dynamics, integrating the advantages of both. Defectors and cooperators form a special semi-stable checkerboard-like state. The update rules, the number of states, and the configuration of conversion actions as strategies have led to this special structure. Moreover, we found that parameter choices in the new evolutionary dynamics affect the percentage of cooperation and evolutionary convergence. Overall, this paper offers new insights into learning dynamics and imitation dynamics and provides a foundation for integrating complex mechanisms of evolution.

Keywords: Public goods game; Learning dynamics; Imitation dynamics; Agent cooperation (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077924009299
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:187:y:2024:i:c:s0960077924009299

DOI: 10.1016/j.chaos.2024.115377

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().