Online belief elicitation methods

Valeria Burdea and Jonathan Woon

Journal of Economic Psychology, 2022, vol. 90, issue C

Abstract: How well do incentivized belief elicitation procedures work in online settings? We evaluate the quality of beliefs elicited from online respondents, comparing several characteristics of two widely used complex elicitation mechanisms (the Binarized Scoring Rule – BSR – and a stochastic variation of the Becker–deGroot–Marschak mechanism—BDM) against a flat fee baseline for a variety of beliefs (induced probabilities, first-order factual knowledge, second-order knowledge of others). We find that the flat-fee method requires the least amount of time, the BDM is the most difficult to understand, and that there are no differences in the average accuracy of induced beliefs across conditions. However, the methods are significantly different in terms of the frequency of first-order and second-order beliefs reported at exactly 50%: the flat-fee method leads to the most mass on this belief, followed by BDM and BSR. Regarding induced beliefs, we also find that less-educated participants’ accuracy is higher in the complex incentives treatments, and that attention, numeracy, and education are positively associated with the quality of these beliefs across methods. Our results suggest that the quality of beliefs elicited in online environments may depend less on the formal incentive compatibility properties of the elicitation procedure (whether the procedure prevents “dishonest” reporting) than on the difficulty of comprehending the task and how well incentives induce cognitive effort (thereby inducing subjects to quantify or construct their beliefs).

Keywords: Belief elicitation; Incentives; Online experiment (search for similar items in EconPapers)
JEL-codes: C81 C89 D83 D91 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167487022000149
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Online Belief Elicitation Methods (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:joepsy:v:90:y:2022:i:c:s0167487022000149

DOI: 10.1016/j.joep.2022.102496

Access Statistics for this article

Journal of Economic Psychology is currently edited by G. Antonides and D. Read

More articles in Journal of Economic Psychology from Elsevier
Bibliographic data for series maintained by Catherine Liu ().