Enhancing the face validity of choice experiments: A simple diagnostic check

Klaus Glenk, Jürgen Meyerhoff, Sergio Colombo and Michela Faccioli

Ecological Economics, 2024, vol. 221, issue C

Abstract: We propose a simple diagnostic check for face validity assessment of willingness to pay (WTP) estimates derived from choice experiments (CEs). The check is based on a threshold value for WTP that is related to the highest cost attribute level, which can be used to assess plausibility of estimated WTP. If the threshold value is exceeded, WTP estimates are considered to overshoot. This may be due to issues with (i) the design of the CE and/or (ii) respondents' behavior deviating from assumptions underpinning CEs. Applying the check to a sample of publications, this paper provides evidence on the incidence and magnitude of overshooting of WTP in the agricultural and environmental CE literature. Based on a random sample of publications including 304 observations representing individual studies and population samples, the results show that overshooting of WTP is widespread, with 65% of observations exceeding the overshooting threshold value. An exploratory analysis to identify factors associated with overshooting of WTP across studies reveals that study design factors, and in particular the design of the cost attribute, play an important role. We recommend that researchers apply the diagnostic check for the design of choice experiments and to motivate further scrutiny of choice experiment results.

Keywords: Validity; Credibility; Stated preference methods; Willingness to pay; Overshooting; Choice experiment design (search for similar items in EconPapers)
JEL-codes: D61 Q51 (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0921800924000570
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecolec:v:221:y:2024:i:c:s0921800924000570

DOI: 10.1016/j.ecolecon.2024.108160

Access Statistics for this article

Ecological Economics is currently edited by C. J. Cleveland

More articles in Ecological Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().