Controlled user evaluations of information visualization interfaces for text retrieval: Literature review and meta‐analysis

Charles‐Antoine Julien, John E. Leide and France Bouthillier

Journal of the American Society for Information Science and Technology, 2008, vol. 59, issue 6, 1012-1024

Abstract: This review describes experimental designs (users, search tasks, measures, etc.) used by 31 controlled user studies of information visualization (IV) tools for textual information retrieval (IR) and a meta‐analysis of the reported statistical effects. Comparable experimental designs allow research designers to compare their results with other reports, and support the development of experimentally verified design guidelines concerning which IV techniques are better suited to which types of IR tasks. The studies generally use a within‐subject design with 15 or more undergraduate students performing browsing to known‐item tasks on sets of at least 1,000 full‐text articles or Web pages on topics of general interest/news. Results of the meta‐analysis (N = 8) showed no significant effects of the IV tool as compared with a text‐only equivalent, but the set shows great variability suggesting an inadequate basis of comparison. Experimental design recommendations are provided which would support comparison of existing IV tools for IR usability testing.

Date: 2008
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.1002/asi.20786

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:59:y:2008:i:6:p:1012-1024

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890

Access Statistics for this article

More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().