Nonparametric learning rules from bandit experiments: the eyes have it!

Yingyao Hu, Yutaka Kayaba and Matthew Shum ()
Additional contact information
Yutaka Kayaba: Institute for Fiscal Studies

No CWP15/10, CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies

Abstract:

We estimate nonparametric learning rules using data from dynamic two-armed bandit (probabilistic reversal learning) experiments, supplemented with auxiliary eye-movement measures of subjects' beliefs. We apply recent econometric developments in the estimation of dynamic models. The direct estimation of learning rules differs from the usual modus operandi of the experimental literature. The estimated choice probabilities and learning rules from our nonparametric models have some distinctive features; notably that subjects tend to update in a non-smooth manner following positive 'exploitative' choices (those made in accordance with current beliefs). Simulation results show how the estimated nonparametric learning rules fit aspects of subjects' observed choice sequences better than alternative parameterized learning rules from Bayesian and reinforcement learning models.

Date: 2010-06-10
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://cemmap.ifs.org.uk/wps/cwp1510.pdf (application/pdf)

Related works:
Journal Article: Nonparametric learning rules from bandit experiments: The eyes have it! (2013)
Working Paper: Nonparametric Learning Rules from Bandit Experiments: The Eyes have it! (2010)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ifs:cemmap:15/10

Ordering information: This working paper can be ordered from
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Access Statistics for this paper

More papers in CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE. Contact information at EDIRC.
Bibliographic data for series maintained by Emma Hyman ().