Multi-task reinforcement learning in humans

Momchil S. Tomov (), Eric Schulz () and Samuel J. Gershman
Additional contact information
Momchil S. Tomov: Harvard Medical School
Eric Schulz: Max Planck Institute for Biological Cybernetics
Samuel J. Gershman: Harvard University

Nature Human Behaviour, 2021, vol. 5, issue 6, 764-773

Abstract: Abstract The ability to transfer knowledge across tasks and generalize to novel ones is an important hallmark of human intelligence. Yet not much is known about human multitask reinforcement learning. We study participants’ behaviour in a two-step decision-making task with multiple features and changing reward functions. We compare their behaviour with two algorithms for multitask reinforcement learning, one that maps previous policies and encountered features to new reward functions and one that approximates value functions across tasks, as well as to standard model-based and model-free algorithms. Across three exploratory experiments and a large preregistered confirmatory experiment, our results provide evidence that participants who are able to learn the task use a strategy that maps previously learned policies to novel scenarios. These results enrich our understanding of human reinforcement learning in complex environments with changing task demands.

Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
https://www.nature.com/articles/s41562-020-01035-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nathum:v:5:y:2021:i:6:d:10.1038_s41562-020-01035-y

Ordering information: This journal article can be ordered from
https://www.nature.com/nathumbehav/

DOI: 10.1038/s41562-020-01035-y

Access Statistics for this article

Nature Human Behaviour is currently edited by Stavroula Kousta

More articles in Nature Human Behaviour from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().