Relation of Observer Agreement to Accuracy According to a Two-receiver Signal Detection Model of Diagnosis
Michael F. Quinn
Medical Decision Making, 1989, vol. 9, issue 3, 196-206
Abstract:
A long-standing problem of medical diagnosis is why rates of observer disagreement are so high. To study this question a model of test interpretation is defined which accounts for disagreement when observers use identical diagnostic strategies. Test subjects are assigned to one of two disease classes on the basis of two parameters: the test score and A, the diagnostic certainty, a parameter analogous to signal-to-noise ratio. The rate of disagreement and the mean error rate of independent ideal observers are derived as a function of diagnostic strategy. It follows from the model that: 1) Maximization of the ratio of disagreement to error defines an optimal diagnostic strategy with advantages over maximum likelihood and Bayes diagnostic strategies. 2) Disagreement exceeds error if the sensitivity and specificity of in dependent observers exceed one-half for all A. 3) The ratio of disagreement to error can be no greater than two if test interpretation is dichotomous but can approach infinity for tricho tomous interpretation, i.e., if observers are allowed to interpret cases as indeterminate.
Keywords: Key words: Bayesian statistics; maximum likelihood; signal-to-noise ratio. (Med Decis Making 1989; 9:196-206) (search for similar items in EconPapers)
Date: 1989
References: View complete reference list from CitEc
Citations:
Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X8900900308 (text/html)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:9:y:1989:i:3:p:196-206
DOI: 10.1177/0272989X8900900308
Access Statistics for this article
More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().