Reflections on Mira: Interactive evaluation in information retrieval

Mark Dunlop

Journal of the American Society for Information Science, 2000, vol. 51, issue 14, 1269-1274

Abstract: Evaluation in information retrieval (IR) has focussed largely on noninteractive evaluation of text retrieval systems. This is increasingly at odds with how people use modern IR systems: in highly interactive settings to access linked, multimedia information. Furthermore, this approach ignores potential improvements through better interface design. In 1996, the Commission of the European Union Information Technologies Programme funded a 3‐year working group, Mira, to discuss and advance research in the area of evaluation frameworks for interactive and multimedia IR applications. Led by Keith van Rijsbergen, Steve Draper, and myself from Glasgow University, this working group brought together many of the leading researchers in the evaluation domain from both the IR and human–computer interaction (HCI) communities. This article presents my personal view of the main lines of discussion that took place throughout Mira: importing and adapting evaluation techniques from HCI, evaluating at different levels as appropriate, evaluating against different types of relevance and the new challenges that drive the need for rethinking the old evaluation approaches. The article concludes that we need to consider more varied forms of evaluation to complement engine evaluation.

Date: 2000
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/1097-4571(2000)9999:99993.0.CO;2-7

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamest:v:51:y:2000:i:14:p:1269-1274

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1097-4571

Access Statistics for this article

More articles in Journal of the American Society for Information Science from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().