Slipping Anchor? Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity

Teresa Bago d'Uva, Maarten Lindeboom (), Owen O'Donnell and Eddy Van Doorslaer

Health, Econometrics and Data Group (HEDG) Working Papers from HEDG, c/o Department of Economics, University of York

Abstract: Anchoring vignettes are increasingly used to identify and correct heterogeneity in the reporting of health, work disability, life satisfaction, political efficacy, etc. with the aim of improving interpersonal comparability of subjective indicators of these constructs. The method relies on two assumptions: vignette equivalence – the vignette description is perceived by all to correspond to the same state; and, response consistency - individuals use the same response scales to rate the vignettes and their own situation. We propose tests of these assumptions. For vignette equivalence, we test a necessary condition of no systematic variation with observed characteristics in the perceived difference in states corresponding to any two vignettes. To test response consistency we rely on the assumption that objective indicators fully capture the covariation between the construct of interest and observed individual characteristics, and so offer an alternative way to identify response scales, which can then be compared with those identified from the vignettes. We also introduce a weaker test that is valid under a less stringent assumption. We apply these tests to cognitive functioning and mobility related health problems using data from the English Longitudinal Survey of Ageing. Response consistency is rejected for both health domains according to the first test, but the weaker test does not reject for cognitive functioning. The necessary condition for vignette equivalence is rejected for both health domains. These results cast some doubt on the validity of the vignettes approach, at least as applied to these health domains.

Keywords: Reporting heterogeneity; Survey methods; Vignettes; Health; Cognition (search for similar items in EconPapers)
JEL-codes: C35 C42 I12 (search for similar items in EconPapers)
Date: 2009-10
New Economics Papers: this item is included in nep-ecm and nep-hea
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (16)

Downloads: (external link)
https://www.york.ac.uk/media/economics/documents/herc/wp/09_30.pdf Main text (application/pdf)

Related works:
Journal Article: Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity (2011)
Working Paper: Slipping Anchor? Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity (2009)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:yor:hectdg:09/30

Access Statistics for this paper

More papers in Health, Econometrics and Data Group (HEDG) Working Papers from HEDG, c/o Department of Economics, University of York HEDG/HERC, Department of Economics and Related Studies, University of York, York, YO10 5DD, United Kingdom. Contact information at EDIRC.
Bibliographic data for series maintained by Jane Rawlings ().