Order Effects in Eliciting Preferences

Orestis Kopsacheilis () and Sebastian Goerg
Additional contact information
Orestis Kopsacheilis: Technical University of Munich

No 16343, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: Having an accurate account of preferences help governments design better policies for their citizens, organizations develop more efficient incentive schemes for their employees and adjust their product to better suit their clients' needs. The plethora of elicitation methods most commonly used can be broadly distinguished between methods that rely on people self-assessing and directly stating their preferences (qualitative) and methods that are indirectly inferring such preferences through choices in some task (quantitative). Alarmingly, the two approaches produce systematically different conclusions about preferences and, therefore, survey designers often include both quantitative and qualitative items. An important methodological question that is hitherto unaddressed is whether the order in which quantitative and qualitative items are encountered affects elicited preferences. We conduct three, pre-registered, studies with a total of 3,000 participants, where we elicit preferences about risk, time-discounting and altruism in variations of two conditions: 'Quantitative First' and 'Qualitative First'. We find significant and systematic order effects. Eliciting preferences through qualitative items first boosts inferred patience and altruism while using quantitative items first increases the cross-method correlation for risk and time preferences. We explore how monetary incentivization and introducing financial context modulates these results and discuss the implications of our findings in the context of nudging interventions as well as our understanding of the nature of preferences.

Keywords: preferences; qualitative vs. quantitative measures; risk; altruism; patience (search for similar items in EconPapers)
JEL-codes: C83 C91 D01 D91 (search for similar items in EconPapers)
Pages: 21 pages
Date: 2023-07
New Economics Papers: this item is included in nep-cbe, nep-exp, nep-nud and nep-upt
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://docs.iza.org/dp16343.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp16343

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().