Statistical Inference for G-indices of Agreement

Douglas G. Bonett
Additional contact information
Douglas G. Bonett: Department of Psychology, University of California, Santa Cruz, CA, USA

Journal of Educational and Behavioral Statistics, 2022, vol. 47, issue 4, 438-458

Abstract: The limitations of Cohen’s κ are reviewed and an alternative G -index is recommended for assessing nominal-scale agreement. Maximum likelihood estimates, standard errors, and confidence intervals for a two-rater G -index are derived for one-group and two-group designs. A new G -index of agreement for multirater designs is proposed. Statistical inference methods for some important special cases of the multirater design also are derived. G -index meta-analysis methods are proposed and can be used to combine and compare agreement across two or more populations. Closed-form sample-size formulas to achieve desired confidence interval precision are proposed for two-rater and multirater designs. R functions are given for all results.

Keywords: nominal agreement; multirater agreement; interval estimation; meta-analysis; sample-size planning (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986221088561 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:47:y:2022:i:4:p:438-458

DOI: 10.3102/10769986221088561

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().