A Note on the Reliability of Ranked Items

Dawn M. Vanleeuwen and Keith H. Mandabach
Additional contact information
Dawn M. Vanleeuwen: New Mexico State University
Keith H. Mandabach: New Mexico State University

Sociological Methods & Research, 2002, vol. 31, issue 1, 87-105

Abstract: Instruments may be designed to use either Likert-type items (ratings) or ranks to obtain priority rankings of items. Models commonly used in generalizability theory (GT) provide a basis for assessing the reliability of item measurements based on ratings. However, these commonly used models do not apply when respondents are required to rank a set of items. Unlike ratings, ranks force subject effects to zero. Furthermore, ranks violate independence assumptions, and the dependence between ranks assigned to different items affects the standard error of item mean differences and, consequently, the reliability of the item comparisons. A GT analysis for ranked items is presented and used to derive standard errors for differences between item means as well as an item measurement reliability coefficient. This analysis uses a linear model that is not typically used in GT analyses but that models those features unique to ranks.

Date: 2002
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0049124102031001004 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:somere:v:31:y:2002:i:1:p:87-105

DOI: 10.1177/0049124102031001004

Access Statistics for this article

More articles in Sociological Methods & Research
Bibliographic data for series maintained by SAGE Publications ().