Modeling anchoring effects in sequential Likert scale questions

Marcin Hitczenko

No 13-15, Working Papers from Federal Reserve Bank of Boston

Abstract: Surveys in many different research fields rely on sequences of Likert scale questions to assess individuals' general attitudes toward a set of related topics. Most analyses of responses to such a series do not take into account the potential measurement error introduced by the context effect we dub \"sequential anchoring,\" which occurs when the rating for one question influences the rating given to the following question by favoring similar ratings. The presence of sequential anchoring can cause systematic bias in the study of relative ratings. We develop a latent-variable framework for question responses that capitalizes on different question orderings in the survey to identify the presence of sequential anchoring. We propose a parameter estimation algorithm and run simulations to test its effectiveness for different data-generating processes, sample sizes, and orderings. Finally, the model is applied to data in which eight payment instruments are rated on a five-point scale for each of six payment characteristics in the 2012 Survey of Consumer Payment Choice. We find consistent evidence of sequential anchoring, resulting in sizable differences in properties of relative ratings for certain instruments.

Keywords: survey bias; latent variable models; EM algorithm; Survey of Consumer Payment Choice (search for similar items in EconPapers)
JEL-codes: C83 (search for similar items in EconPapers)
Pages: 42 pages
Date: 2013-12-09
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://www.bostonfed.org/economic/wp/wp2013/wp1315.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedbwp:13-15

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Working Papers from Federal Reserve Bank of Boston Contact information at EDIRC.
Bibliographic data for series maintained by Catherine Spozio ().