Evaluation of confidence intervals for the kappa statistic when the assumption of marginal homogeneity is violated

Sameer Parpia (), John Koval and Allan Donner

Computational Statistics, 2013, vol. 28, issue 6, 2709-2718

Abstract: This article studies the robustness of confidence interval construction for the intraclass kappa statistic based on a dichotomous response when the assumption of marginal homogeneity across two raters is violated. Two methods of construction are considered: the goodness-of-fit approach and the modified Wald method. Evaluation was done by exact calculation of the confidence interval coverage produced by these approaches. It was found that under mild departures from marginal homogeneity (differences in rater success rates of $$>$$ > 10 %), the goodness- of-fit approach can be recommended. Moreover, under these same conditions, Cohen’s kappa tends to be less biased as a point estimator than the intraclass kappa statistic. Copyright Springer-Verlag Berlin Heidelberg 2013

Keywords: Agreement; Goodness-of-fit; Modified Wald; Exact computation; Common correlation model (search for similar items in EconPapers)
Date: 2013
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1007/s00180-013-0424-7 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:28:y:2013:i:6:p:2709-2718

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-013-0424-7

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().