A generalization of the uniform association model for assessing rater agreement in ordinal scales

Alireza Akbarzadeh Bagheban and Farid Zayeri

Journal of Applied Statistics, 2010, vol. 37, issue 8, 1265-1273

Abstract: Recently, the data analysts pay more attention to the assessment of rater agreement, especially in areas of medical sciences. In this context, the statistical indices such as kappa and weighted kappa are the most common choices. These indices are simple to calculate and interpret, although, they fail to describe the structure of agreement, particularly when the available outcome has an ordinal nature. In the previous decades, statisticians suggested more efficient statistical tools such as diagonal parameter, linear by linear association and agreement plus linear by linear association models for describing the structure of rater agreement. In these models, the equal interval scores are the common choice for the levels of the ordinal scales. In this manuscript, we show that choosing the common equal interval scores does not necessarily lead to the best fit and propose a modification using a power transformation for the ordinal scores. We also use two different data sets (IOTN and ovarian masses data) to illustrate our suggestion more clearly. In addition, we utilize the category distinguishability concept for interpreting the model parameter estimates.

Keywords: rater agreement; association model; log-linear model; ordinal scales (search for similar items in EconPapers)
Date: 2010
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.tandfonline.com/doi/abs/10.1080/02664760903012666 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:japsta:v:37:y:2010:i:8:p:1265-1273

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/CJAS20

DOI: 10.1080/02664760903012666

Access Statistics for this article

Journal of Applied Statistics is currently edited by Robert Aykroyd

More articles in Journal of Applied Statistics from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().