How measurement noise limits the accuracy of brain-behaviour predictions

Martin Gell (), Simon B. Eickhoff, Amir Omidvarnia, Vincent Küppers, Kaustubh R. Patil, Theodore D. Satterthwaite, Veronika I. Müller and Robert Langner ()
Additional contact information
Martin Gell: RWTH Aachen University
Simon B. Eickhoff: Research Centre Jülich
Amir Omidvarnia: Research Centre Jülich
Vincent Küppers: Research Centre Jülich
Kaustubh R. Patil: Research Centre Jülich
Theodore D. Satterthwaite: University of Pennsylvania
Veronika I. Müller: Research Centre Jülich
Robert Langner: Research Centre Jülich

Nature Communications, 2024, vol. 15, issue 1, 1-12

Abstract: Abstract Major efforts in human neuroimaging strive to understand individual differences and find biomarkers for clinical applications by predicting behavioural phenotypes from brain imaging data. To identify generalisable and replicable brain-behaviour prediction models, sufficient measurement reliability is essential. However, the selection of prediction targets is predominantly guided by scientific interest or data availability rather than psychometric considerations. Here, we demonstrate the impact of low reliability in behavioural phenotypes on out-of-sample prediction performance. Using simulated and empirical data from four large-scale datasets, we find that reliability levels common across many phenotypes can markedly limit the ability to link brain and behaviour. Next, using 5000 participants from the UK Biobank, we show that only highly reliable data can fully benefit from increasing sample sizes from hundreds to thousands of participants. Our findings highlight the importance of measurement reliability for identifying meaningful brain–behaviour associations from individual differences and underscore the need for greater emphasis on psychometrics in future research.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.nature.com/articles/s41467-024-54022-6 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nat:natcom:v:15:y:2024:i:1:d:10.1038_s41467-024-54022-6

Ordering information: This journal article can be ordered from
https://www.nature.com/ncomms/

DOI: 10.1038/s41467-024-54022-6

Access Statistics for this article

Nature Communications is currently edited by Nathalie Le Bot, Enda Bergin and Fiona Gillespie

More articles in Nature Communications from Nature
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().