Contrasting Two Frameworks for ROC Analysis of Ordinal Ratings

Daryl E. Morris, Margaret Sullivan Pepe and William E. Barlow
Additional contact information
Daryl E. Morris: Biostatistics and Biomathematics, Fred Hutchinson Cancer Research Center, Seattle, Washington
Margaret Sullivan Pepe: Biostatistics and Biomathematics, Fred Hutchinson Cancer Research Center, Seattle, Washington, mspepe@u.washington.edu
William E. Barlow: Group Health Center for Health Studies, Seattle, Washington

Medical Decision Making, 2010, vol. 30, issue 4, 484-498

Abstract: Background. Statistical evaluation of medical imaging tests used for diagnostic and prognostic purposes often employs receiver operating characteristic (ROC) curves. Two methods for ROC analysis are popular. The ordinal regression method is the standard approach used when evaluating tests with ordinal values. The direct ROC modeling method is a more recently developed approach, motivated by applications to tests with continuous values. Objective. The authors compare the methods in terms of model formulations, interpretations of estimated parameters, the ranges of scientific questions that can be addressed with them, their computational algorithms, and the efficiencies with which they use data. Results. The authors show that a strong relationship exists between the methods by demonstrating that they fit the same models when only a single test is evaluated. The ordinal regression models are typically alternative parameterizations of the direct ROC models and vice versa. The direct method has two major advantages over the ordinal regression method: 1) estimated parameters relate directly to ROC curves, facilitating interpretations of covariate effects on ROC performance, and 2) comparisons between tests can be done directly in this framework. Comparisons can be made while accommodating covariate effects and even between tests that have values on different scales, such as between a continuous biomarker test and an ordinal valued imaging test. The ordinal regression method provides slightly more precise parameter estimates from data in our simulated data models. Conclusion. Although the ordinal regression method is slightly more efficient, the direct ROC modeling method has important advantages in regard to interpretation, and it offers a framework to address a broader range of scientific questions, including the facility to compare tests.

Keywords: comparisons; covariates; diagnostic test; markers; ordinal regression; percentile values. (search for similar items in EconPapers)
Date: 2010
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X09357477 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:30:y:2010:i:4:p:484-498

DOI: 10.1177/0272989X09357477

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().