Granular Q-learning adaptation boosts collective welfare in multi-agent Prisoner’s Dilemma

Hsuan-Wei Lee and Yi-Ning Weng

Chaos, Solitons & Fractals, 2025, vol. 199, issue P1

Abstract: Understanding how cooperation emerges and stabilizes in a difficult environment is a core challenge across biology, physics, and the social sciences. We present a reinforcement-learning framework for the Prisoner’s Dilemma Game between the two distinct agent types: Interactive Identity (II) and Interactive Diversity (ID). While II agents compress all neighbor interactions into one strategy update, ID agents assign one strategy to each neighbor, enabling finer-grained strategic adaptation. We systematically sweep dilemma strengths and analyze both homogeneous and heterogeneous network structures to show that ID agents persistently outcompete II agents at sustaining cooperation, especially for moderate temptations to defect. Moreover, in scenarios where agents can shift from II to ID based on relative payoffs, ID learning often invades populations of II learners, though influential hub nodes can impede this transition in heterogeneous networks. Spatiotemporal analyses indicate that ID agents form a strong cluster of cooperation, which prevents defection from spreading. Finally, extrapolating these results to wider moral dimensions, such as honesty, trust, and punishment, can give a rich understanding of how this granular, neighbor-specific learning raises collective welfare within both natural ecosystems and engineered multi-agent systems.

Keywords: Reinforcement learning; Cooperation; Evolutionary games; Interactive diversity; Social networks (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925006551
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:199:y:2025:i:p1:s0960077925006551

DOI: 10.1016/j.chaos.2025.116642

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().