A within-sample investigation of test–retest reliability in choice experiment surveys with real economic incentives

Morten Mørkbak and Søren Olsen

Australian Journal of Agricultural and Resource Economics, 2015, vol. 59, issue 3

Abstract: In this paper, we investigate the level of agreement between respondents’ choices in identical choice sets in a test–retest choice experiment for a market good with real economic incentives, thus investigating whether the incentivised CE method can be reliable and stable over time. Besides comparing choices, we also test for differences in preferences and error variance when a sample of respondents is given the exact same questionnaire twice, with a time lag of 2 weeks in between. Finally, we examine potential reasons and covariates explaining the level of agreement in choices across the 2 weeks. Across four different tests, we find very good agreement between the two choice experiments – both with respect to overall choices and with respect to preferences. Furthermore, error variances do not differ significantly between the two surveys. The results also show that the larger the utility difference in a choice task, the larger the probability that the respondent will choose the same alternative in the retest. Moreover, the results show that the longer time respondents take to answer the 12 choice sets in the retest, the lower the probability that the respondent will choose the same alternatives in the retest as they did in the test.

Keywords: Research; Methods/Statistical; Methods (search for similar items in EconPapers)
Date: 2015
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://ageconsearch.umn.edu/record/283206/files/ajar12067.pdf (application/pdf)

Related works:
Journal Article: A within-sample investigation of test–retest reliability in choice experiment surveys with real economic incentives (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ags:aareaj:283206

DOI: 10.22004/ag.econ.283206

Access Statistics for this article

More articles in Australian Journal of Agricultural and Resource Economics from Australian Agricultural and Resource Economics Society Contact information at EDIRC.
Bibliographic data for series maintained by AgEcon Search ().