Q-learning update with second-order reputation promotes the evolution of trust within structured populations

Yuying Zhu, Bohua Xing and Chengyi Xia

Chaos, Solitons & Fractals, 2025, vol. 199, issue P1

Abstract: The Q-learning characterizes how individuals adjust strategies to adapt to the environment, while its interaction with the reputation evaluation in trust games remains underexplored despite their coexistence in real systems. This paper combines the Q-learning algorithm with the second-order social norms to analyze the evolution of altruistic behaviors within the framework of networked N-player trust game. Given different dilemma intensities, the Q-learning mechanism yields richer steady-state strategy distributions than the traditional Fermi rule, which only considers immediate payoffs and exhibits inhibition of trustworthy behaviors. Then, based on four second-order reputation evaluation rules, it is shown that, even when the dilemma intensity is large, the Shunning rule still can help to improve global wealth. In addition, we analyze the role of critical parameters in reinforcement learning, including the learning coefficient, reward discount factor and exploration probability, thus determining the effectiveness of the proposed mode. Sensitivity analysis reveals that large learning rates and discount factor contribute to increasing global wealth, while a smaller exploration rate is crucial for maintaining trust and wealth accumulation. The proposed strategy update model yields greater adaptive flexibility in complex environments and provides a new perspective for understanding the maintenance and evolution of trust behaviors in complex social systems.

Keywords: Q-learning; Second-order reputation; Trust game (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925006666
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:199:y:2025:i:p1:s0960077925006666

DOI: 10.1016/j.chaos.2025.116653

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().