Are we doing more harm than good? Hypothetical bias reduction techniques in potentially consequential survey settings

Vasudha Chopra () and Christian Vossler
Additional contact information
Vasudha Chopra: Plaksha University

No 2024-03, Working Papers from University of Tennessee, Department of Economics

Abstract: Researchers deploying stated preference surveys to elicit monetary valuations for public goods commonly use techniques devised to reduce bias in hypothetical choice settings. This practice is conceptually at odds with accumulated evidence that most survey respondents instead perceive that their decisions have economic consequences (i.e., affect their future welfare). We examine three bias reduction procedures in both hypothetical choice and incentive compatible, real payment settings: cheap talk, solemn oath, and certainty adjustment. While we find that the oath reduces willingness to pay (WTP) in a hypothetical setting, the oath instead increases WTP by over 30% in a consequential setting. Cheap talk does not alter mean WTP in a consequential setting but leads to a stark difference in WTP across sexes. Applying the common rules for ex post adjustment of choices based on stated response certainty leads to significant and large decreases in WTP estimates for both hypothetical and consequential cases. Our results suggest that survey researchers should make use of screening questions to better target hypothetical bias reduction techniques to only those prone to bias.

Keywords: hypothetical bias; consequentiality; stated preferences; experiments; solemn oath; cheap talk; certainty adjustment (search for similar items in EconPapers)
JEL-codes: C92 D82 D9 H41 Q51 (search for similar items in EconPapers)
Pages: 47 pages
Date: 2024-11
New Economics Papers: this item is included in nep-dcm, nep-ecm and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://web.utk.edu/~jhollad3/RePEc/2024-03.pdf First version, 2024 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ten:wpaper:2024-03

Access Statistics for this paper

More papers in Working Papers from University of Tennessee, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Scott Holladay ().