Homogeneity test and sample size of response rates for AC 1 in a stratified evaluation design

Jia Jingwei, Liu Yuanbo, Yang Jikai and Li Zhiming ()
Additional contact information
Jia Jingwei: College of Mathematics and System Science, 47907 Xinjiang University , Urumqi, China
Liu Yuanbo: College of Mathematics and System Science, 47907 Xinjiang University , Urumqi, China
Yang Jikai: College of Mathematics and System Science, 47907 Xinjiang University , Urumqi, China
Li Zhiming: College of Mathematics and System Science, 47907 Xinjiang University , Urumqi, China

The International Journal of Biostatistics, 2025, vol. 21, issue 1, 17-35

Abstract: Gwet’s first-order agreement coefficient (AC 1) is widely used to evaluate the consistency between raters. Considering the existence of a certain relationship between the raters, the paper aims to test the equality of response rates and the dependency between two raters of modified AC 1’s in a stratified design and estimates the sample size for a given significance level. We first establish a probability model and then estimate the unknown parameters. Further, we explore the homogeneity test of these AC 1’s under the asymptotic method, such as likelihood ratio, score, and Wald-type statistics. In numerical simulation, the performance of statistics is investigated in terms of type I error rates (TIEs) and power while finding a suitable sample size under a given power. The results show that the Wald-type statistic has robust TIEs and satisfactory power and is suitable for large samples (n≥50). Under the same power, the sample size of the Wald-type test is smaller when the number of strata is large. The higher the power, the larger the required sample size. Finally, two real examples are given to illustrate these methods.

Keywords: the first-order agreement coefficient; homogeneity test; asymptotic statistic; sample size; confidence interval (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/ijb-2024-0080 (text/html)
For access to full text, subscription to the journal or payment for the individual article is required.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:ijbist:v:21:y:2025:i:1:p:17-35:n:1012

Ordering information: This journal article can be ordered from
https://www.degruyte ... journal/key/ijb/html

DOI: 10.1515/ijb-2024-0080

Access Statistics for this article

The International Journal of Biostatistics is currently edited by Antoine Chambaz, Alan E. Hubbard and Mark J. van der Laan

More articles in The International Journal of Biostatistics from De Gruyter
Bibliographic data for series maintained by Peter Golla ().