Tools for checking calibration of a Cox model in external validation: Approach based on individual event probabilities

Patrick Royston ()
Additional contact information
Patrick Royston: Hub for Trials Methodology Research, MRC Clinical Trials Unit at UCL

Stata Journal, 2014, vol. 14, issue 4, 738-755

Abstract: The Cox proportional hazards model has been used extensively in medicine over the last 40 years. A popular application is to develop a multivariable prediction model, often a prognostic model to predict the clinical outcome of patients with a particular disorder from "baseline" factors measured at some initial time point. For such a model to be useful in practice, it must be "validated"; that is, it must perform satisfactorily in an external sample of patients independent of the sample on which the model was originally developed. One key aspect of performance is calibration, which is the accuracy of prediction, particularly of survival (or equivalently, failure or event) probabilities at any time after the time origin. We believe systematic evaluation of the calibration of a Cox model has been largely ignored in the literature. In this article, we suggest an approach to assessing calibration using individual event probabilities estimated at different time points. We exemplify the method by detailed analysis of two datasets in the disease primary biliary cirrhosis; the datasets comprise a derivation and a validation dataset. We describe a new command, stcoxcal, that performs the necessary calculations. Results for stcoxcal can be displayed graphically, which makes it easier for users to picture calibration (or lack thereof) according to follow-up time. Copyright 2014 by StataCorp LP.

Keywords: stcoxcal; Cox proportional hazards model; multivariable model; prognostic factors; external validation; calibration; survival probabilities (search for similar items in EconPapers)
Date: 2014
Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj14-4/st0357/
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.stata-journal.com/article.html?article=st0357 link to article purchase

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tsj:stataj:v:14:y:2014:i:4:p:738-755

Ordering information: This journal article can be ordered from
http://www.stata-journal.com/subscription.html

Access Statistics for this article

Stata Journal is currently edited by Nicholas J. Cox and Stephen P. Jenkins

More articles in Stata Journal from StataCorp LLC
Bibliographic data for series maintained by Christopher F. Baum () and Lisa Gilmore ().