Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks

Talira Kucina (), Lindsay Wells, Ian Lewis, Kristy Salas, Amelia Kohl, Matthew A. Palmer, James D. Sauer, Dora Matzke, Eugene Aidman and Andrew Heathcote
Additional contact information
Talira Kucina: University of Tasmania
Lindsay Wells: University of Tasmania
Ian Lewis: University of Tasmania
Kristy Salas: University of Tasmania
Amelia Kohl: University of Tasmania
Matthew A. Palmer: University of Tasmania
James D. Sauer: University of Tasmania
Dora Matzke: University of Amsterdam
Eugene Aidman: Defence Science Technology Group
Andrew Heathcote: University of Amsterdam

Nature Communications, 2023, vol. 14, issue 1, 1-14

Abstract: Abstract Standard, well-established cognitive tasks that produce reliable effects in group comparisons also lead to unreliable measurement when assessing individual differences. This reliability paradox has been demonstrated in decision-conflict tasks such as the Simon, Flanker, and Stroop tasks, which measure various aspects of cognitive control. We aim to address this paradox by implementing carefully calibrated versions of the standard tests with an additional manipulation to encourage processing of conflicting information, as well as combinations of standard tasks. Over five experiments, we show that a Flanker task and a combined Simon and Stroop task with the additional manipulation produced reliable estimates of individual differences in under 100 trials per task, which improves on the reliability seen in benchmark Flanker, Simon, and Stroop data. We make these tasks freely available and discuss both theoretical and applied implications regarding how the cognitive testing of individual differences is carried out.

Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.nature.com/articles/s41467-023-37777-2 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-37777-2

Ordering information: This journal article can be ordered from
https://www.nature.com/ncomms/

DOI: 10.1038/s41467-023-37777-2

Access Statistics for this article

Nature Communications is currently edited by Nathalie Le Bot, Enda Bergin and Fiona Gillespie

More articles in Nature Communications from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().