The Correlation of Sorted Scores Rule

Kimmo Sorjonen, Guy Madison, Bo Melin and Fredrik Ullén

Intelligence, 2020, vol. 80, issue C

Abstract: The worst performance rule (WPR) states that participants' worst performances on multi-trial tasks, e.g. in reaction time, are more predictive of their general intelligence than are better performances. A common interpretation of the WPR is that poor performances reflect momentary lapses in attention and executive control, which occur more frequently in individuals with low IQ. Here, we first present analyses of simulated data, which indicate that WPR-like phenomena may occur as a function of certain statistical relations between the within-individual variance of multiple test scores and other measures of interest. Specifically, we propose that the WPR is a special case of the more general Correlation of Sorted Scores Rule (CSSR). According to the CSSR, a negative correlation between the test score percentile of sorted scores, e.g. in reaction time, and the test score × construct (e.g. g) correlation, will be seen if the within-individual variance on the tests has a negative correlation with the construct. However, if the latter correlation is positive, the CSSR predicts a positive association also between test score percentiles and test score × construct correlations, i.e. a “best performance rule”. Secondly, we test this hypothesis using analyses in a large cohort (N = 5467) with empirical data on reaction time and intelligence. These results replicate the main findings from the simulation study and, importantly, provide further support for the key prediction of the CSSR, i.e. that samples with a positive correlation between reaction time variance and intelligence tend to show a “best performance rule”.

Keywords: Correlation of sorted scores rule; Intelligence; Within-individual variance; Reaction time; Simulation; Worst performance rule (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0160289620300325
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:intell:v:80:y:2020:i:c:s0160289620300325

DOI: 10.1016/j.intell.2020.101454

Access Statistics for this article

Intelligence is currently edited by R.J. Haier

More articles in Intelligence from Elsevier
Bibliographic data for series maintained by Catherine Liu ().