Selected results from an inquiry into testing of information retrieval systems

Tefko Saracevic

Journal of the American Society for Information Science, 1971, vol. 22, issue 2, 126-139

Abstract: A variety of aspects related to testing of retrieval systems were examined. A model of a retrieval system, together with a set of measures and a methodology for performance testing were developed. In the main experiment the effect on performance of the following variables was tested: sources of indexing, indexing languages, coding schemes, question analyses, search strategies and formats of output. In addition, a series of separate experiments was carried out to investigate the problems of controls in experimentation with IR systems. The main conclusions: the human factor appears to be the main variable in all components of an IR system; length of indexes affects performance considerably more than indexing languages; question analyses and search strategies affect performance to a great extent—as much, if not more than indexing. Retrieval systems seem to be able to perform at present only on a general level, failing to be at the same time comprehensive and specific. It seems that testing of total IR systems controlling and monitoring all factors (environmental and systems‐related) is not possible at present.

Date: 1971
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/asi.4630220212

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamest:v:22:y:1971:i:2:p:126-139

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1097-4571

Access Statistics for this article

More articles in Journal of the American Society for Information Science from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().