Systematic Measurement Error Can be Detected and Quantified by Performing Ordinary Statistical Tests on Item Errors

Michael Beatty, Faith Siem, Craigory Brown and Steven Shenouda

No f4jrh, OSF Preprints from Center for Open Science

Abstract: Self-report measures are ubiquitous in behavioral science and have been a key method used to examine evolutionary hypotheses. Indeed, evidence for the existence and functional boundaries of many psychological adaptations is inferred based on responses on self-report measures. Valid inferences based on self-report data require that questionnaire items measure only the construct they were designed to measure, which in statistical terms means that measurement error is predominately random. In contrast, systematic error indicates that items measure constructs in addition to those the instrument was designed to measure. Substantial systematic error associated with measures used in research risks theoretically consistent interpretations that are, instead, spurious effects of method error. Here, we propose a strategy for estimating the portion of systematic measurement error contained in multi-item self-report measures. This strategy rests on the observation that item-errors can be treated like any other set of scores and therefore have the potential to reveal otherwise unnoticed patterns in the data.

Date: 2023-08-24
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/64e783b8939a2308357f725d/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:f4jrh

DOI: 10.31219/osf.io/f4jrh

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().