In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts

Hanna Grol-Prokopczyk

The Journals of Gerontology: Series B, 2018, vol. 73, issue 1, 54-63

Abstract: ObjectiveAnchoring vignettes appear with growing frequency in surveys of health and aging, but little research investigates how to optimize their wording. This study experimentally tests whether mentioning specific health conditions and/or medical procedures enhances or undermines vignette validity. Methods: Three series of general health anchoring vignettes were fielded to 2,550 respondents in the Wisconsin Longitudinal Study: one mentioning no specific health conditions or procedures, one mentioning heart disease-related ones, and one mentioning diabetes-related ones. Variations on hierarchical ordered probit models were used to test whether vignette wording affected adherence to the key measurement assumptions of vignette equivalence (VE) and response consistency (RC). Results: While all vignette series showed substantial violations of VE, violations were larger (especially by sex and education) when using disease-specific texts. RC violations appeared relatively minor, but somewhat larger in disease-specific texts. Discussion: These findings suggest that more general, universal vignette texts may be preferable to ones describing highly specific conditions/procedures. The common advice to prioritize specificity and concreteness in survey texts may be misguided if sociodemographic groups differ in their familiarity or associations with the presented details. Anchoring vignettes are a potentially useful survey tool, but further efforts are needed to optimize their wording.

Keywords: Anchoring vignettes; Differential item functioning; Health measurement; Reporting heterogeneity; Self-rated health; Survey design (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1093/geronb/gbx048 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:geronb:v:73:y:2018:i:1:p:54-63.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Journals of Gerontology: Series B is currently edited by Psychological Sciences - S. Duke Han, PhD and Social Sciences - Jessica A Kelley, PhD, FGSA

More articles in The Journals of Gerontology: Series B from The Gerontological Society of America Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().