Mesolimbic dopamine adapts the rate of learning from action

Luke T. Coddington (), Sarah E. Lindo and Joshua T. Dudman ()
Additional contact information
Luke T. Coddington: Janelia Research Campus
Sarah E. Lindo: Janelia Research Campus
Joshua T. Dudman: Janelia Research Campus

Nature, 2023, vol. 614, issue 7947, 294-302

Abstract: Abstract Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions1–3. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction4; however, so far there has been little consideration of how direct policy learning might inform our understanding5. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning6.

Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.nature.com/articles/s41586-022-05614-z Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:nature:v:614:y:2023:i:7947:d:10.1038_s41586-022-05614-z

Ordering information: This journal article can be ordered from
https://www.nature.com/

DOI: 10.1038/s41586-022-05614-z

Access Statistics for this article

Nature is currently edited by Magdalena Skipper

More articles in Nature from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().