How Cognitive Interviewing can Provide Validity Evidence of the Response Processes to Scale Items

Miguel Castillo-Díaz () and José-Luis Padilla

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 2013, vol. 114, issue 3, 963-975

Abstract: The current theory about validity reflected in the Standards for Educational and Psychological Testing (AERA et al. in Standards for educational and psychological testing, American Psychological Association, Washington, DC, 1999 ), offers no clear indications about the methods for gathering validity evidence about the response processes. Cognitive interviewing (CI) can play an important role answering the current demand about empirical and theoretical analyses of the response processes as a source of validity evidence in psychological testing. CI can provide validity evidence for investigating substantive aspects of construct validity and for contributing to the explanations for item and test scores (Zumbo in Handbook of statistics, vol 26, Elsevier, Amsterdam, pp. 45–79, 2007 ; The concept of validity: revisions, new directions and applications, IAP—Information Age Publishing Inc., Charlotte, NC, pp. 65–82, 2009 ). The aim of the study was to illustrate the use of cognitive interviewing method for gathering validity evidence on response processes. The search for evidence about the “response process” was guided by an argument-based approach to validity (Kane in Psychological Bulletin 1992 ; Educational measurement, American Council on Education/Praeger, Washington, DC, pp. 17–64, 2006 ). 21 cognitive interviews were carried out during the cognitive testing of the APGAR psychological scale intended to measure the “family support” construct. Cognitive interviewing provided validity evidence that explains how respondents interpret and respond to the APGAR items. Respondents maintained a shared interpretation of “family concept” while answering the APGAR scale items. Nevertheless, they included in the concept of family not only family members they live with but also other family members and even friends. CI participants were also capable of classifying their answers about the family support perception following a polythomous response system. Lastly, the role of CI in the Kane’s argument-based approach and Zumbo’s contextualized view of validity will be discussed. Copyright Springer Science+Business Media Dordrecht 2013

Keywords: Cognitive interviewing; Construct validity; APGAR; Cognitive response processes (search for similar items in EconPapers)
Date: 2013
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://hdl.handle.net/10.1007/s11205-012-0184-8 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:soinre:v:114:y:2013:i:3:p:963-975

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11205-012-0184-8

Access Statistics for this article

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement is currently edited by Filomena Maggino

More articles in Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().