Confidence Intervals and F Tests for Intraclass Correlation Coefficients Based on Three-Way Mixed Effects Models

Hong Zhou, Paige Muellerleile, Debra Ingram and Seok P. Wong

Journal of Educational and Behavioral Statistics, 2011, vol. 36, issue 5, 638-671

Abstract: Intraclass correlation coefficients (ICCs) are commonly used in behavioral measurement and psychometrics when a researcher is interested in the relationship among variables of a common class. The formulas for deriving ICCs, or generalizability coefficients, vary depending on which models are specified. This article gives the equations for computing confidence intervals and conducting F tests for three-way mixed models with one fixed facet, extending the work on random effects models produced by Wong and McGraw. It provides the formula for finding the confidence interval for generalizability coefficients in the situations in which n i ′ is not necessarily equal to n i , where n i and n i ′ are the number of levels of facet i in generalizability and decision studies, respectively. The authors provide the formulas for finding n i ′ when the researcher wishes to maintain a minimum desired generalizability coefficient. Finally, the authors illustrate the analytic differences among four models using one hypothetical data set and then use real data from student course evaluations to further illustrate one of the four models.

Keywords: evaluation; generalizability theory; psychometrics; statistics; test theory/development; validity/reliability (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998610381399 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:36:y:2011:i:5:p:638-671

DOI: 10.3102/1076998610381399

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().