Dynamic noise estimation: a generalized method for modeling noise fluctuations in decision-making

Jing Jing Li, Chengchun Shi, Lexin Li and Anne G.E. Collins

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Computational cognitive modeling is an important tool for understanding the processes supporting human and animal decision-making. Choice data in decision-making tasks are inherently noisy, and separating noise from signal can improve the quality of computational modeling. Common approaches to model decision noise often assume constant levels of noise or exploration throughout learning (e.g., the ϵ-softmax policy). However, this assumption is not guaranteed to hold – for example, a subject might disengage and lapse into an inattentive phase for a series of trials in the middle of otherwise low-noise performance. Here, we introduce a new, computationally inexpensive method to dynamically estimate the levels of noise fluctuations in choice behavior, under a model assumption that the agent can transition between two discrete latent states (e.g., fully engaged and random). Using simulations, we show that modeling noise levels dynamically instead of statically can substantially improve model fit and parameter estimation, especially in the presence of long periods of noisy behavior, such as prolonged lapses of attention. We further demonstrate the empirical benefits of dynamic noise estimation at the individual and group levels by validating it on four published datasets featuring diverse populations, tasks, and models. Based on the theoretical and empirical evaluation of the method reported in the current work, we expect that dynamic noise estimation will improve modeling in many decision-making paradigms over the static noise estimation method currently used in the modeling literature, while keeping additional model complexity and assumptions minimal.

Keywords: attention; cognitive modeling; decision noise; decision-making; hidden Markov model; lapses; reinforcement learning; task-engagement; 1R01MH119383 (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Pages: 11 pages
Date: 2024-04-01
New Economics Papers: this item is included in nep-dcm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Journal of Mathematical Psychology, 1, April, 2024, 119. ISSN: 0022-2496

Downloads: (external link)
http://eprints.lse.ac.uk/122383/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:122383

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().