The reinforcement learning model with heterogeneous learning rate in activity-driven networks

Dun Han and Youxin He
Additional contact information
Dun Han: School of Mathematical Sciences, Jiangsu University, Zhenjiang, Jiangsu 212013, P. R. China
Youxin He: School of Mathematical Sciences, Jiangsu University, Zhenjiang, Jiangsu 212013, P. R. China

International Journal of Modern Physics C (IJMPC), 2023, vol. 34, issue 07, 1-11

Abstract: Agent’s learning behavior usually presents biased judgments influenced by many internal and external reasons, we incorporate an improved Q-learning algorithm in the reinforcement learning which is examined with the prisoner’s dilemma game in an activity-driven networks. The heterogeneous learning rate and ϵ-greedy exploration mechanism are taken into account while modeling decision-making of agents. Simulation results show the proposed reinforcement learning mechanism is conducive to the emergence of defective behavior, i.e. it could maximize one’s expected payoff regardless of its neighbors’ strategy. In addition, we find the temptation gain, vision level and the number of connected edges of activated agents are proportional to the density of defectors. Interestingly, when the inherent learning rate is small, the increase of exploration rate can demote the appearance of defectors, and the decrease of defectors is insignificant by increasing of exploration rate conversely.

Keywords: Q-learning algorithm; heterogeneous learning rate; activity-driven networks; Prisoner’s dilemma game (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0129183123500924
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijmpcx:v:34:y:2023:i:07:n:s0129183123500924

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0129183123500924

Access Statistics for this article

International Journal of Modern Physics C (IJMPC) is currently edited by H. J. Herrmann

More articles in International Journal of Modern Physics C (IJMPC) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().