Battery order effects on relative ratings in Likert scales
No 17-2, Research Data Report from Federal Reserve Bank of Boston
Likert-scale batteries, sequences of questions with the same ordinal response choices, are often used in surveys to collect information about attitudes on a related set of topics. Analysis of such data often focuses on the study of relative ratings or the likelihood that one item is given a lower (or higher) rating than another item. This work studies how different orderings of the items within a battery and, in particular, the relative location of items affect relative rating distributions. We take advantage of data from the 2012?2014 Survey of Consumer Payment Surveys, in which item order in six Likert-scale batteries is varied among respondents. We find that ordering effects are real and consistent across years. The most prominent effect relating to relative locations of items is that the farther one item is placed after another item, the more likely that item is to have a lower rating.
Keywords: survey design; hierarchical models; ordinal responses (search for similar items in EconPapers)
JEL-codes: C83 (search for similar items in EconPapers)
Pages: 25 pages
References: View references in EconPapers View complete reference list from CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
https://www.bostonfed.org/publications/research-da ... n-likert-scales.aspx Summary (text/html)
https://www.bostonfed.org/-/media/Documents/Workingpapers/PDF/2017/rdr1702.pdf Full text (application/pdf)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:fip:fedbdr:17-2
Ordering information: This working paper can be ordered from
Access Statistics for this paper
More papers in Research Data Report from Federal Reserve Bank of Boston Contact information at EDIRC.
Bibliographic data for series maintained by ().