Decision Curve Analysis: A Novel Method for Evaluating Prediction Models

Andrew J. Vickers and Elena B. Elkin
Additional contact information
Andrew J. Vickers: Department of Epidemiology and Biostatistics, Department of Urology, and Department of Medicine, Memorial Sloan-Kettering Cancer Center, New York; vickersa@mskcc.org.
Elena B. Elkin: Department of Epidemiology and Biostatistics, Memorial Sloan-Kettering Cancer Center, New York.

Medical Decision Making, 2006, vol. 26, issue 6, 565-574

Abstract: Background. Diagnostic and prognostic models are typically evaluated with measures of accuracy that do not address clinical consequences. Decision-analytic techniques allow assessment of clinical outcomes but often require collection of additional information and may be cumbersome to apply to models that yield a continuous result. The authors sought a method for evaluating and comparing prediction models that incorporates clinical consequences, requires only the data set on which the models are tested, and can be applied to models that have either continuous or dichotomous results. Method . The authors describe decision curve analysis, a simple, novel method of evaluating predictive models. They start by assuming that the threshold probability of a disease or event at which a patient would opt for treatment is informative of how the patient weighs the relative harms of a false-positive and a false-negative prediction. This theoretical relationship is then used to derive the net benefit of the model across different threshold probabilities. Plotting net benefit against threshold probability yields the “decision curve.†The authors apply the method to models for the prediction of seminal vesicle invasion in prostate cancer patients. Decision curve analysis identified the range of threshold probabilities in which a model was of value, the magnitude of benefit, and which of several models was optimal. Conclusion . Decision curve analysis is a suitable method for evaluating alternative diagnostic and prognostic strategies that has advantages over other commonly used measures and techniques.

Keywords: prediction models; multivariate analysis; decision analysis (search for similar items in EconPapers)
Date: 2006
References: View complete reference list from CitEc
Citations: View citations in EconPapers (36)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X06295361 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:26:y:2006:i:6:p:565-574

DOI: 10.1177/0272989X06295361

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().