Designing Scalar Questions for Web Surveys

Leah Melani Christian, Nicholas L. Parsons and Don A. Dillman
Additional contact information
Leah Melani Christian: Pew Research Center for the People & the Press, Washington, DC
Nicholas L. Parsons: Eastern Connecticut State University, Willimantic, CT
Don A. Dillman: Washington State University, Pullman, WA

Sociological Methods & Research, 2009, vol. 37, issue 3, 393-425

Abstract: This paper explores how the visual design of scalar questions influences responses in web surveys. We present the results of five experiments embedded in two web surveys of university students. We find that consistently presenting the positive end of the scale first did not impact responses but increases response times. Displaying the categories in multiple columns influence how respondents process the scale and increase response times. Separating the midpoint, ``don't know'' option, or endpoints spatially does not impact responses when the visual and conceptual midpoint align. Removing the graphical layout of the scale influences responses when lower numbers indicate more positive categories and increases response time. Finally, response times are longer for polar point scales with numeric labels, but there are no differences in responses. Overall, our results suggest that the visual design of response scales impacts measurement, but that some manipulations produce larger and more significant differences than others.

Keywords: web surveys; visual design; scalar questions; measurement (search for similar items in EconPapers)
Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0049124108330004 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:somere:v:37:y:2009:i:3:p:393-425

DOI: 10.1177/0049124108330004

Access Statistics for this article

More articles in Sociological Methods & Research
Bibliographic data for series maintained by SAGE Publications ().