Corrective feedback guides human perceptual decision-making by informing about the world state rather than rewarding its choice

Hyang-Jung Lee, Heeseung Lee, Chae Young Lim, Issac Rhim and Sang-Hun Lee

PLOS Biology, 2023, vol. 21, issue 11, 1-32

Abstract: Corrective feedback received on perceptual decisions is crucial for adjusting decision-making strategies to improve future choices. However, its complex interaction with other decision components, such as previous stimuli and choices, challenges a principled account of how it shapes subsequent decisions. One popular approach, based on animal behavior and extended to human perceptual decision-making, employs “reinforcement learning,” a principle proven successful in reward-based decision-making. The core idea behind this approach is that decision-makers, although engaged in a perceptual task, treat corrective feedback as rewards from which they learn choice values. Here, we explore an alternative idea, which is that humans consider corrective feedback on perceptual decisions as evidence of the actual state of the world rather than as rewards for their choices. By implementing these “feedback-as-reward” and “feedback-as-evidence” hypotheses on a shared learning platform, we show that the latter outperforms the former in explaining how corrective feedback adjusts the decision-making strategy along with past stimuli and choices. Our work suggests that humans learn about what has happened in their environment rather than the values of their own choices through corrective feedback during perceptual decision-making.Corrective feedback is crucial for making real-world decisions, but how does it influence subsequent choices? This computational study reveals that humans do not consider such feedback as a reward for value but as evidence to learn about the statistical structure of a given perceptual task, offering a principled account of the historical effects in both directions of time.

Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002373 (text/html)
https://journals.plos.org/plosbiology/article/file ... 02373&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pbio00:3002373

DOI: 10.1371/journal.pbio.3002373

Access Statistics for this article

More articles in PLOS Biology from Public Library of Science
Bibliographic data for series maintained by plosbiology ().