Respondent Understanding in Discrete Choice Experiments: A Scoping Review
Alison Pearce (),
Deborah J. Street,
Nick Bansback and
Additional contact information
Mark Harrison: University of British Columbia
Deborah J. Street: University of Technology Sydney
Kirsten Howard: University of Sydney
Nick Bansback: University of British Columbia
Stirling Bryan: University of British Columbia
The Patient: Patient-Centered Outcomes Research, 2021, vol. 14, issue 1, No 4, 17-53
Abstract Introduction Despite the recognised importance of participant understanding for valid and reliable discrete choice experiment (DCE) results, there has been limited assessment of whether, and how, people understand DCEs, and how ‘understanding’ is conceptualised in DCEs applied to a health context. Objectives Our aim was to identify how participant understanding is conceptualised in the DCE literature in a health context. Our research questions addressed how participant understanding is defined, measured, and used. Methods Searches were conducted (June 2019) in the MEDLINE, EMBASE, PsychINFO and Econlit databases, as well as hand searching. Search terms were based on previous DCE systematic reviews, with additional understanding keywords used in a proximity-based search strategy. Eligible studies were peer-reviewed journal articles in the field of health, related to DCE or best-worst scaling type 3 (BWS3) studies, and reporting some consideration or assessment of participant understanding. A descriptive analytical approach was used to chart relevant data from each study, including publication year, country, clinical area, subject group, sample size, study design, numbers of attributes, levels and choice sets, definition of understanding, how understanding was tested, results of the understanding tests, and how the information about understanding was used. Each study was categorised based on how understanding was conceptualised and used within the study. Results Of 306 potentially eligible articles identified, 31 were excluded based on titles and abstracts, and 200 were excluded on full-text review, resulting in 75 included studies. Three categories of study were identified: applied DCEs (n = 52), pretesting studies (n = 7) and studies of understanding (n = 16). Typically, understanding was defined in relation to either the choice context, such as attribute terminology, or the concept of choosing. Very few studies considered respondents’ engagement as a component of understanding. Understanding was measured primarily through qualitative pretesting, rationality or validity tests included in the survey, and participant self-report, however reporting and use of the results of these methods was inconsistent. Conclusions Those conducting or using health DCEs should carefully select, justify, and report the measurement and potential impact of participant understanding in their specific choice context. There remains scope for research into the different components of participant understanding, particularly related to engagement, the impact of participant understanding on DCE validity and reliability, the best measures of understanding, and methods to maximise participant understanding.
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2) Track citations by RSS feed
Downloads: (external link)
http://link.springer.com/10.1007/s40271-020-00467-y Abstract (text/html)
Access to the full text of the articles in this series is restricted.
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:spr:patien:v:14:y:2021:i:1:d:10.1007_s40271-020-00467-y
Ordering information: This journal article can be ordered from
Access Statistics for this article
The Patient: Patient-Centered Outcomes Research is currently edited by Christopher I. Carswell
More articles in The Patient: Patient-Centered Outcomes Research from Springer, International Academy of Health Preference Research
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().