Exploiting the maximum entropy principle to increase retrieval effectiveness

William S. Cooper

Journal of the American Society for Information Science, 1983, vol. 34, issue 1, 31-39

Abstract: Several of the drawbacks of conventional information retrieval systems can be overcome by a design approach in which queries consist of sets of terms, either unweighted or weighted with subjective term precision estimates, and retrieval outputs are ranked by probability of usefulness estimated in accordance with the so‐called “maximum entropy principle.” A system organized along these lines combines the convenience of a simple input language with a powerful probabilistic inference mechanism capable of exploiting kinds of statistical clues not ordinarily used in systems of traditional design. The sensitivity of the maximum entropy principle to the frequencies and joint frequencies with which terms have been assigned to documents in the collection results in a system design of increased power and expressiveness without a concomitant increase in the complexity of the request language. It incorporates the more important search capabilities of both Boolean and conventional weighted‐request languages and facilitates the use of unconventional search clues.

Date: 1983
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1002/asi.4630340106

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamest:v:34:y:1983:i:1:p:31-39

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1097-4571

Access Statistics for this article

More articles in Journal of the American Society for Information Science from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().