Planned and Post Hoc Comparisons in Tests of Concordance and Discordance forG Groups of Judges

Ronald C. Serlin and Leonard A. Marascuilo

Journal of Educational and Behavioral Statistics, 1983, vol. 8, issue 3, 187-205

Abstract: Statistical procedures for making comparisons on the ranking of a set ofK elements, wines, people, and so forth, have been worked out for the case in which the ranking is done by a single group ofn people. In this special situation, Friedman’s test can be called upon to assess the significance of differences in mean ranking, and Kendall’s coefficient of concordance can be used to measure the level of agreement among the individuals doing the ranking. Unfortunately, the problem of comparingG groups of subjects to determine whether or not they produce the same mean ranking has, until recently, remained unanswered. A procedure was developed for testing two-group concordance by Schucany and Frawley. Hollander and Sethuraman have questioned this procedure and have provided an alternative model for investigating the same problem. It is easy to show that the Schucany and Frawley model tests for positive rank correlation in the mean ranks as an alternative, whereas the Hollander and Sethuraman model tests identity of mean ranks across theK compared elements as the null. In this article, these two models are examined, the criticism is evaluated, and both models are extended to theG group situation. The extension to planned and post hoc comparisons is illustrated using data based on a study described by Marascuilo and Dagenais.

Date: 1983
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986008003187 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:8:y:1983:i:3:p:187-205

DOI: 10.3102/10769986008003187

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().