Use of relevance criteria across stages of document evaluation: On the complementarity of experimental and naturalistic studies
Rong Tang and
Paul Solomon
Journal of the American Society for Information Science and Technology, 2001, vol. 52, issue 8, 676-685
Abstract:
This paper provides an overview of empirical investigations of people's use of relevance criteria. A laboratory experiment and a naturalistic study were conducted to explore the patterns of movement in use of relevance criteria during real‐time document evaluation processes. The expectation was that the subjects would apply different frames of reference for relevance decision making as they moved from one stage of the document evaluation to another, and that change would occur not only for particular criteria but also for classes of criteria. The examination of such change was performed at two levels: a micro‐level analysis, centering on the use of individual criteria, and a macro‐level analysis, concentrating on the use of criteria classes. General results of the two studies are included in this paper. Both projects provided information on criteria patterns, which challenge the conventional meaning‐based approach to criteria classification. Building on these findings, a classification scheme and criteria taxonomy that may enable generalization of criteria across different contexts is proposed.
Date: 2001
References: Add references at CitEc
Citations:
Downloads: (external link)
https://doi.org/10.1002/asi.1116
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:52:y:2001:i:8:p:676-685
Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890
Access Statistics for this article
More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().