How to Learn to Defeat Noisy Robot in Rock-Paper-Scissors Game: An Exploratory Study

Gregory Chernov
Additional contact information
Gregory Chernov: National Research University Higher School of Economics, Moscow, Russia

HSE Economic Journal, 2020, vol. 24, issue 4, 503–538

Abstract: This paper studies learning in strategic environment using experimental data from the Rock-Paper-Scissors game. In a repeated game framework, we explore the response of human subjects to uncertain behavior of strategically sophisticated opponent. We model this opponent as a robot who played a stationary strategy with superimposed noise varying across four experimental treatments. Using experimental data from 85 subjects playing against such a stationary robot for 100 pe riods, we show that humans can decode their strategies, on average outperforming the random response to such a robot by 17%. Further, we show that human ability to recognize such strategies decreases with exogenous noise in the behavior of the robot. Further, we fit learning data to classical Reinforcement Learning (RL) and Fictitious Play (FP) models and show that the classic action-based approach to lear­ning is inferior to the strategy-based one. Unlike the previous papers in this field,e.g. Ioannou, Romero (2014), we extend and adapt the strategy-based learning techniques to the 3?3 game. We also show, using a combination of experimental and expost survey data, that human participants are better at learning separate components of an opponent's strategy than in recognizing this strategy as a whole. This decomposition offers them a shorter and more intuitive way to figure out their own best response. We build a strategic extension of the classical learning models accounting for these behavioral phenomena.

Keywords: adaptive learning; repeated games; scoring rules; simulation methods; belief learning; repeated-game strategies (search for similar items in EconPapers)
JEL-codes: C53 C57 C73 D83 D91 (search for similar items in EconPapers)
Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ej.hse.ru/en/2020-24-4/427831329.html (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hig:ecohse:2020:4:2

Access Statistics for this article

More articles in HSE Economic Journal from National Research University Higher School of Economics
Bibliographic data for series maintained by Editorial board () and Editorial board ().