Is Easier Better Than Harder? An Experiment on Choice Experiments for Benefit-Risk Tradeoff Preferences

Jui-Chen Yang, Shelby D. Reed, Steve Hass, Mark B. Skeen and F. Reed Johnson
Additional contact information
Jui-Chen Yang: Duke Clinical Research Institute, Duke University, Durham, NC, USA
Shelby D. Reed: Duke Clinical Research Institute, Duke University, Durham, NC, USA
Steve Hass: H. E. Outcomes, LLC, Los Angeles, CA, USA
Mark B. Skeen: Duke University Health System, Durham, NC, USA
F. Reed Johnson: Duke Clinical Research Institute, Duke University, Durham, NC, USA

Medical Decision Making, 2021, vol. 41, issue 2, 222-232

Abstract: Objectives To test the convergent validity of simple and more complex study designs in a discrete-choice experiment (DCE) of multiple sclerosis (MS) treatment preferences. Methods Five hundred US adults with MS completed an online DCE survey. Respondents answered 8 choice questions with pairs of constructed MS treatment profiles defined by delays in problems with walking, delays in problems with cognition, thyroid disorders, and 10-y risks of kidney failure and serious brain infection (i.e., progressive multifocal leukoencephalopathy [PML]). Four hundred respondents completed choice questions using 4 levels for all attributes, except thyroid disorders with 3 levels. One hundred respondents completed choice questions using only the 2 extreme attribute levels of the 4-level version. Random-parameters logit models were used to estimate choice-model parameters. Results Respondents viewing the 4-level and 2-level versions agreed on the relative importance of the 3 most important attributes: cognition, walking, and PML. Respondents viewing the 4-level version indicated much stronger disutility for a 0% to 0.5% increase in kidney-failure risk than those viewing the 2-level version where the risk for kidney failure increased from 0% to 3%. Otherwise, utilities for other 4-level attributes were approximately linear but with significantly steeper slopes (except for cognition) than the 2-level estimates, indicating that attributes were perceived as more important as the number of levels increased. Conclusions Although the relative importance of some attributes was similar, the 2-level and 4-level versions generally failed to demonstrate convergent validity. If the study goal is attribute rankings, a 2-level version could be adequate. If goals include quantifying tradeoffs among attribute levels, more complex designs can help respondents discriminate among attribute levels. Reductions in measurement error using fewer attribute levels appear to have come at the expense of less discriminating evaluations.

Keywords: choice complexity; design of designs; discrete-choice experiment (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X20979833 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:41:y:2021:i:2:p:222-232

DOI: 10.1177/0272989X20979833

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().