Ordering effects in discrete choice experiments: A systematic literature review across domains

Sander Boxebeld

Journal of choice modelling, 2024, vol. 51, issue C

Abstract: Discrete choice experiments (DCEs) are increasingly used in several scientific domains. Since their results may be used to inform governmental decision-making, it is important that the validity of the method is continuously scrutinized. An often-studied design artefact is the impact of the presentation order of alternatives, attributes, and choice sets on the results of a DCE. No systematic review of the literature on ordering effects existed until now, and many applied studies using a DCE do not explicitly consider the role of ordering effects. I conducted a systematic review of the literature on ordering effects in this study. Using a three-step snowball sampling strategy, 85 studies were identified across various scientific domains. The majority of included studies documented statistically significant ordering effects. Alternative and attribute ordering effects are primarily caused by lexicographic behaviours, while choice set ordering effects seem to be caused by respondent learning, fatigue, or anchoring. Although ordering effects may not always occur, the majority of studies that did find statistically significant effects warrants the use of mitigation methods. An overview of potential mitigation methods for the applied DCE literature is presented, including randomization of presentation orders, advance disclosure of DCE core elements, and inclusion of alternative-specific constants (ASCs), attribute level overlap, and an instructional choice set (ICS). Finally, several directions for future methodological research on this topic are provided, particularly regarding heterogeneity in ordering effects by study design traits and respondent characteristics, and interactions between ordering effects. Insights in these aspects would further our understanding of respondents’ processing of DCEs.

Keywords: Discrete choice experiment; Ordering effects; Left–right bias; Learning; Fatigue; Anchoring (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1755534524000216
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:eejocm:v:51:y:2024:i:c:s1755534524000216

DOI: 10.1016/j.jocm.2024.100489

Access Statistics for this article

Journal of choice modelling is currently edited by S. Hess and J.M. Rose

More articles in Journal of choice modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().