The Effects of Features of Survey Measurement on Self-Rated Health: Response Option Order and Scale Orientation

Dana Garbarski (), Nora Cate Schaeffer () and Jennifer Dykema ()
Additional contact information
Dana Garbarski: Loyola University Chicago
Nora Cate Schaeffer: University of Wisconsin-Madison
Jennifer Dykema: University of Wisconsin-Madison

Applied Research in Quality of Life, 2019, vol. 14, issue 2, No 14, 545-560

Abstract: Abstract Self-rated health (SRH) is widely used to study health across a range of disciplines. However, relatively little research examines how features of its measurement in surveys influence respondents’ answers and the overall quality of the resulting measurement. Manipulations of response option order and scale orientation are particularly relevant to assess for SRH given the increasing prominence of web-based survey data collection and since these factors are often outside of the control of the researcher who is analyzing data collected by other investigators. We examine how the interplay of two features of SRH influence respondents’ answers in a 2-by-3 factorial experiment that varies (1) the order in which the response options are presented (“excellent” to “poor” or “poor” to “excellent”) and (2) the orientation of the response option scale (vertical, horizontal, or banked). The experiment was conducted online using workers from Amazon Mechanical Turk (N = 2945). We find no main effects of response scale orientation and no interaction between response option order and scale orientation. However, we find main effects of response option order: mean SRH and the proportion in “excellent” or “very good” health are higher (better) and the proportion in “fair” or “poor” health lower when the response options are ordered from “excellent” to “poor” compared to “poor” to “excellent.” We also see heterogeneous treatment effects of response option ordering across respondents’ characteristics associated with ability. Overall, the implications for the validity and cross-survey comparability of SRH are likely considerable for response option ordering and minimal for scale orientation.

Keywords: Self-rated health; Questionnaire design; Response option order; Scale orientation; Web survey; Amazon mechanical turk (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://link.springer.com/10.1007/s11482-018-9628-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:ariqol:v:14:y:2019:i:2:d:10.1007_s11482-018-9628-x

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11482

DOI: 10.1007/s11482-018-9628-x

Access Statistics for this article

Applied Research in Quality of Life is currently edited by Daniel Shek

More articles in Applied Research in Quality of Life from Springer, International Society for Quality-of-Life Studies
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().