Disentangling Selection Into Mode From Mode Effects

Colm O’Muircheartaigh, L Philip Schumm, Ned English and Becki Curtis

The Journals of Gerontology: Series B, 2025, vol. 80, issue Supplement_1, S8-S16

Abstract: ObjectivesWe investigate the impact of data collection mode on responses to variables in the National Social Life, Health, and Aging Project (NSHAP) Round 4 and discuss how potential mode differences should (and should not) be addressed in substantive analyses.MethodsAmong the set of respondents who were eligible to be contacted remotely in Round 4, we randomly selected 398 to be contacted instead for an in-person interview. We compare response rates and the distributions of selected key outcomes among those 398 respondents to those among the control group who were initially approached remotely. In contrast, we compared all R4 respondents according to the mode in which they completed the interview, including those not part of the randomized experiment.ResultsAmong those included in the experiment, there was no evidence of systematic differences in responses to physical and mental health questions between remote and in-person modes, nor in responses to number recall measures. In-person respondents scored moderately lower on cognitive function measures requiring careful attention to a figure and/or task, though this difference became less with each similar item. Remote respondents named fewer social network members. Comparing all respondents according to their final mode yielded substantially different results in all cases.DiscussionMode did not appear to affect reports of physical and mental health based on a randomized comparison, though it did moderately affect other items in predictable ways. Naïve estimates of mode effects based on comparing all respondents according to mode yielded misleading results, and should not be used to adjust for mode differences in analyses.

Keywords: Experimental design; Mode effects; Multimode; Surveys (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1093/geronb/gbae140 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:geronb:v:80:y:2025:i:supplement_1:p:s8-s16.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Journals of Gerontology: Series B is currently edited by Psychological Sciences - S. Duke Han, PhD and Social Sciences - Jessica A Kelley, PhD, FGSA

More articles in The Journals of Gerontology: Series B from The Gerontological Society of America Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().