Modeling anchoring effects in sequential Likert scale questions
No 13-15, Working Papers from Federal Reserve Bank of Boston
Surveys in many different research fields rely on sequences of Likert scale questions to assess individuals' general attitudes toward a set of related topics. Most analyses of responses to such a series do not take into account the potential measurement error introduced by the context effect we dub \"sequential anchoring,\" which occurs when the rating for one question influences the rating given to the following question by favoring similar ratings. The presence of sequential anchoring can cause systematic bias in the study of relative ratings. We develop a latent-variable framework for question responses that capitalizes on different question orderings in the survey to identify the presence of sequential anchoring. We propose a parameter estimation algorithm and run simulations to test its effectiveness for different data-generating processes, sample sizes, and orderings. Finally, the model is applied to data in which eight payment instruments are rated on a five-point scale for each of six payment characteristics in the 2012 Survey of Consumer Payment Choice. We find consistent evidence of sequential anchoring, resulting in sizable differences in properties of relative ratings for certain instruments.
Keywords: survey bias; latent variable models; EM algorithm; SCPC (search for similar items in EconPapers)
JEL-codes: C83 (search for similar items in EconPapers)
Pages: 42 pages
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6) Track citations by RSS feed
Downloads: (external link)
http://www.bostonfed.org/economic/wp/wp2013/wp1315.pdf Full text (application/pdf)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:fip:fedbwp:13-15
Ordering information: This working paper can be ordered from
Access Statistics for this paper
More papers in Working Papers from Federal Reserve Bank of Boston Contact information at EDIRC.
Bibliographic data for series maintained by ().