The Mode Effect of Web-Based Surveying on the 2018 U.S. Health and Retirement Study Measure of Cognitive Functioning

Benjamin W Domingue, Ryan J McCammon, Brady T West, Kenneth M Langa, David R Weir, Jessica Faul and Alyssa Gamaldo

The Journals of Gerontology: Series B, 2023, vol. 78, issue 9, 1466-1473

Abstract: ObjectivesMeasuring cognition in an aging populabtion is a public health priority. A move towards survey measurement via the web (as opposed to phone or in-person) is cost-effective but challenging as it may induce bias in cognitive measures. We examine this possibility using an experiment embedded in the 2018 wave of data collection for the U.S. Health and Retirement Study (HRS).MethodsWe utilize techniques from multiple group item response theory to assess the effect of survey mode on performance on the HRS cognitive measure. We also study the problem of attrition by attempting to predict dropout and via approaches meant to minimize bias in subsequent inferences due to attrition.ResultsWe find evidence of an increase in scores for HRS respondents who are randomly assigned to the web-based mode of data collection in 2018. Web-based respondents score higher in 2018 than experimentally matched phone-based respondents, and they show much larger gains relative to 2016 performance and subsequently larger declines in 2020. The differential in favor of web-based responding is observed across all items, but is most pronounced for the Serial 7 task and numeracy items. Due to the relative ease of the web-based mode, we suggest a cutscore of 12 being used to indicate CIND (cognitively impaired but not demented) status when using the web-based version rather than 11.DiscussionThe difference in mode may be nonignorable for many uses of the HRS cognitive measure. In particular, it may require reconsideration of some cutscore-based approaches to identify impairment.

Keywords: Cognition; DIF; HRS; IRT; Mode Effect; Psychometrics (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/geronb/gbad068 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:geronb:v:78:y:2023:i:9:p:1466-1473.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Journals of Gerontology: Series B is currently edited by Psychological Sciences - S. Duke Han, PhD and Social Sciences - Jessica A Kelley, PhD, FGSA

More articles in The Journals of Gerontology: Series B from The Gerontological Society of America Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().