Comparing the predictive powers of survival models using Harrell’s C or Somers’ D

Roger Newson

Stata Journal, 2010, vol. 10, issue 3, 339-358

Abstract: Medical researchers frequently make statements that one model pre- dicts survival better than another, and they are frequently challenged to provide rigorous statistical justification for those statements. Stata provides the estat concordance command to calculate the rank parameters Harrell’s C and Somers’ D as measures of the ordinal predictive power of a model. However, no confidence limits or p-values are provided to compare the predictive power of distinct models. The somersd package, downloadable from Statistical Software Components, can provide such confidence intervals, but they should not be taken seriously if they are calculated in the dataset in which the model was fit. Methods are demonstrated for fitting alternative models to a training set of data, and then measuring and comparing their predictive powers by using out-of-sample prediction and somersd in a test set to produce statistically sensible confidence intervals and p-values for the differences between the predictive powers of different models. Copyright 2010 by StataCorp LP.

Keywords: somersd; stcox; estat concordance; streg; predict; survival; model validation; prediction; concordance; rank methods; Harrell’s C; Somers’ D (search for similar items in EconPapers)
Date: 2010
Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj10-3/st0198/
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.stata-journal.com/article.html?article=st0198 link to article download

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tsj:stataj:v:10:y:2010:i:3:p:339-358

Ordering information: This journal article can be ordered from
http://www.stata-journal.com/subscription.html

Access Statistics for this article

Stata Journal is currently edited by Nicholas J. Cox and Stephen P. Jenkins

More articles in Stata Journal from StataCorp LLC
Bibliographic data for series maintained by Christopher F. Baum () and Lisa Gilmore ().