A Statistical Approach to Assessment of Agreement Involving Multiple Raters

A. S. Hedayat, Congrong Lou and Bikas K. Sinha

Communications in Statistics - Theory and Methods, 2009, vol. 38, issue 16-17, 2899-2922

Abstract: Study of agreement between two or more comparable sets of measurements taken on each member of a population is needed in many areas. There is an impressive literature on the topic covering both the qualitative and quantitative features of study variables. In order to ascertain the extent of agreement between the quantitative ‘target’ variable X and the quantitative ‘test’ variable Y, coverage probability (CP) was introduced by Lin et al. (2002). CP is defined as the probability of (X, Y) falling into a strip along the direction of X = Y of a judiciously specified width 2d but symmetric with respect to X and Y. For a given d, the higher CP value is, the better agreement it indicates. This article dwells on the concept of agreement involving three or more comparable quantitative measurements taken on each member of a population. We contemplate on a situation wherein we have available a reference gold standard against which several competitors are to be compared with respect to their performance as judged by the CP. We also address the problem of judging the performance of the competitors in the absence of any prescribed gold standard.

Date: 2009
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610920902947220 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:38:y:2009:i:16-17:p:2899-2922

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610920902947220

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().