Experience-Weighted Attraction Learning in Games: A Unifying Approach

Colin Camerer () and Teck Ho ()

No 1003, Working Papers from California Institute of Technology, Division of the Humanities and Social Sciences

Abstract: We describe a general model, 'experience-weighted attraction' (EWA) learning, which includes reinforcement learning and a class of weighted fictitious play belief models as special cases. In EWA, strategies have attractions which reflect prior predispositions, are updated based on payoff experience, and determine choice probabilities according to some rule (e.g., logit). A key feature is a parameter δ which weights the strength of hypothetical reinforcement of strategies which were not chosen according to the payoff they would have yielded. When δ = 0 choice reinforcement results. When δ = 1, levels of reinforcement of strategies are proportional to expected payoffs given beliefs based on past history. Another key feature is the growth rates of attractions. The EWA model controls the growth rates by two decay parameters, φ and ρ, which depreciate attractions and amount of experience separately. When φ = ρ belief-based models result; when ρ = 0 choice reinforcement results. Using three data sets, parameter estimates of the model were calibrated on part of the data and used to predict the rest. Estimates of δ are generally around .50, φ around 1, and ρ varies from 0 to φ. Choice reinforcement models often outperform belief-based models in the calibration phase and underperform in out-of-sample validation. Both special cases are generally rejected in favor of EWA, though sometimes belief models do better. EWA is able to combine the best features of both approaches, allowing attractions to begin and grow exibly as choice reinforcement does, but reinforcing unchosen strategies substantially as belief-based models implicitly do.

Keywords: Learning; behavioral game theory; reinforcement learning; fictitious play (search for similar items in EconPapers)
Pages: 42 pages
Date: 1997-03
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.hss.caltech.edu/SSPapers/wp1003.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://www.hss.caltech.edu/SSPapers/wp1003.pdf [301 Moved Permanently]--> https://www.hss.caltech.edu/SSPapers/wp1003.pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:clt:sswopa:1003

Ordering information: This working paper can be ordered from
Working Paper Assistant, Division of the Humanities and Social Sciences, 228-77, Caltech, Pasadena CA 91125

Access Statistics for this paper

More papers in Working Papers from California Institute of Technology, Division of the Humanities and Social Sciences Working Paper Assistant, Division of the Humanities and Social Sciences, 228-77, Caltech, Pasadena CA 91125.
Bibliographic data for series maintained by Victoria Mason ().