Incorporating reputation into reinforcement learning can promote cooperation on hypergraphs

Kuan Zou and Changwei Huang

Chaos, Solitons & Fractals, 2024, vol. 186, issue C

Abstract: Most previous studies that investigate the evolutionary dynamics of cooperation in the multi-agent social dilemma only consider the pairwise interactions. However, pairwise interactions alone cannot adequately characterize the higher-order interaction relationships that are commonly present in real-world social systems. In this study, we propose a spatial public goods game on uniform random hypergraphs with reputation mechanism and self-regarding Q-learning algorithm, where agents take an action based on the Q-value and update their reputation by the first-order evaluation norm. We define the reward as a function of the agent’s payoff and their reputation influenced by the social attention degree. Simulation results indicate that an increase in the social attention degree can effectively facilitate cooperation, as social reputation incentivizes agents to adopt cooperative actions to obtain optimal rewards. Additionally, we find that the discount factor and the learning rate both significantly impact the evolution of cooperation, with the influence of the learning rate on the evolution of cooperation being dependent on the discount factor. Finally, the robustness of this model is demonstrated based on the results of theoretical analysis.

Keywords: Reputation; Reinforcement learning; Hypergraphs; Spatial public goods game (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077924007550
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:186:y:2024:i:c:s0960077924007550

DOI: 10.1016/j.chaos.2024.115203

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().