A Study of Coder Variability

Graham Kalton and Richard Stowel

Journal of the Royal Statistical Society Series C, 1979, vol. 28, issue 3, 276-289

Abstract: Survey questionnaires often contain open‐ended questions, for which interviewers are required to record respondents' replies verbatim. Errors can arise in coding these replies in preparation for statistical analysis. The paper reports the results of an experiment examining the levels of reliability attained by six professional coders in making judgemental codings of a sample of responses to six survey questions. A sizeable degree of unreliability was found, especially with the use of general and “catch‐all” codes. Intra‐coder correlation coefficients, measuring the correlated component of coder variance, were generally small; it is noted, however, that even small values of these coefficients can lead to a substantial loss in precision for survey results.

Date: 1979
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2307/2347199

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssc:v:28:y:1979:i:3:p:276-289

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9876

Access Statistics for this article

Journal of the Royal Statistical Society Series C is currently edited by R. Chandler and P. W. F. Smith

More articles in Journal of the Royal Statistical Society Series C from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().