The retrieval effectiveness of five clustering algorithms as a function of indexing exhaustivity

Robert Burgin

Journal of the American Society for Information Science, 1995, vol. 46, issue 8, 562-572

Abstract: The retrieval effectiveness of five hierarchical clustering methods (single link, complete link, group average, Ward's method, and weighted average) is examined as a function of indexing exhaustivity with four test collections (CF, Cranfield, Medlars, and Time). Evaluations of retrieval effectiveness, based on three measures of optimal retrieval performance, confirm earlier findings that the performance of a retrieval system based on single‐link clustering varies as a function of indexing exhaustively but fail to find similar patterns for other clustering methods. The data also confirm earlier findings regarding the poor performance of single‐link clustering in a retrieval environment. The poor performance of single‐link clustering appears to derive from that method's tendency to produce a small number of large, ill‐defined document clusters. By contrast, the data examined here found the retrieval performance of the other clustering methods to be generally comparable. The data presented here also provide an opportunity to examine the theoretical limits of cluster‐based retrieval and to compare these theoretical limits to the effectiveness of operational implementations. Performance standards for the four document collections examined here were found to vary widely, and the effectiveness of operational implementations were found to be in the range defined as “unacceptable.” Further improvements in search strategies and document representations warrant investigation. © 1995 John Wiley & Sons, Inc.

Date: 1995
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/(SICI)1097-4571(199509)46:83.0.CO;2-B

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamest:v:46:y:1995:i:8:p:562-572

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1097-4571

Access Statistics for this article

More articles in Journal of the American Society for Information Science from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().