Optimal learning dynamics of multiagent system in restless multiarmed bandit game

Kazuaki Nakayama, Ryuzo Nakamura, Masato Hisakado and Shintaro Mori

Physica A: Statistical Mechanics and its Applications, 2020, vol. 549, issue C

Abstract: Social learning is learning through the observation of or interaction with other individuals; it is critical in the understanding of the collective behaviors of humans in social physics. We study the learning process of agents in a restless multiarmed bandit (rMAB). The binary payoff of each arm changes randomly and agents maximize their payoffs by exploiting an arm with payoff 1, searching the arm at random (individual learning), or copying an arm exploited by other agents (social learning). The system has Pareto and Nash equilibria in the mixed strategy space of social and individual learning. We study several models in which agents maximize their expected payoffs in the strategy space, and demonstrate analytically and numerically that the system converges to the equilibria. We also conducted an experiment and investigated whether human participants adopt the optimal strategy. In this experiment, three participants play the game. If the reward of each group is proportional to the sum of the payoffs, the median of the social learning rate almost coincides with that of the Pareto equilibrium.

Keywords: Nash equilibrium; Pareto optimum; Optimal learning dynamics; Multiagent system; Multiarmed bandit (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437120301023
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:549:y:2020:i:c:s0378437120301023

DOI: 10.1016/j.physa.2020.124314

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().