An Omnibus Test for Systematic Changes in Judges’ Rankings

Douglas E. Critchlow and Joseph S. Verducci

Journal of Educational and Behavioral Statistics, 1992, vol. 17, issue 1, 1-26

Abstract: Paired rankings arise when each subject in a study independently ranks a set of items, undergoes a treatment, and afterwards ranks the same set of items. For such data, a statistical test is proposed to detect if the subjects’ posttreatment rankings have moved systematically toward some unknown ranking or set of rankings. The null hypothesis for this test is that each subject’s post-treatment ranking is symmetrically distributed about his pretreatment ranking. The exact and asymptotic null distributions of the test statistic are simulated and compared, and the power of the test is studied. Using paired rankings from an experimental course in literary criticism, we also offer some graphical methods for representing such data that help us to interpret the test results.

Keywords: paired rankings; nonparametrics; graphical methods for permutations (search for similar items in EconPapers)
Date: 1992
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986017001001 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:17:y:1992:i:1:p:1-26

DOI: 10.3102/10769986017001001

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().