Dynamic learning in behavioral games: A hidden Markov mixture of experts approach

Asim Ansari (), Ricardo Montoya () and Oded Netzer ()

Quantitative Marketing and Economics (QME), 2012, vol. 10, issue 4, 475-503

Abstract: Over the course of a repeated game, players often exhibit learning in selecting their best response. Research in economics and marketing has identified two key types of learning rules: belief and reinforcement. It has been shown that players use either one of these learning rules or a combination of them, as in the Experience-Weighted Attraction (EWA) model. Accounting for such learning may help in understanding and predicting the outcomes of games. In this research, we demonstrate that players not only employ learning rules to determine what actions to choose based on past choices and outcomes, but also change their learning rules over the course of the game. We investigate the degree of state dependence in learning and uncover the latent learning rules and learning paths used by the players. We build a non-homogeneous hidden Markov mixture of experts model which captures shifts between different learning rules over the course of a repeated game. The transition between the learning rule states can be affected by the players’ experiences in the previous round of the game. We empirically validate our model using data from six games that have been previously used in the literature. We demonstrate that one can obtain a richer understanding of how different learning rules impact the observed strategy choices of players by accounting for the latent dynamics in the learning rules. In addition, we show that such an approach can improve our ability to predict observed choices in games. Copyright Springer Science+Business Media, LLC 2012

Keywords: Learning; Behavioral game theory; Experimental economics; Hidden Markov mixture of experts model; Bayesian estimation; c5; c7; c11; D83 (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://hdl.handle.net/10.1007/s11129-012-9125-8 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:qmktec:v:10:y:2012:i:4:p:475-503

Ordering information: This journal article can be ordered from
http://www.springer. ... ng/journal/11129/PS2

DOI: 10.1007/s11129-012-9125-8

Access Statistics for this article

Quantitative Marketing and Economics (QME) is currently edited by Pradeep Chintagunta

More articles in Quantitative Marketing and Economics (QME) from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().