On the foundation of evaluation

W. M. Shaw, Jr.

Journal of the American Society for Information Science, 1986, vol. 37, issue 5, 346-348

Abstract: In this article the derivation of a general retrieval effectiveness measure is investigated. It is shown that the measure cannot be justified on the basis of formal considerations associated with measurement theory. The implications of the mathematical condition which defines the relative importance a user assigns to precision and recall are also investigated. Inconsistencies in the definition of the associated weight are resolved, and it is shown that the influence of the weight on the effectiveness measure can produce counterintuitive results. An alternative effectiveness measure provided by the MZ‐metric is recommended. © 1986 John Wiley & Sons, Inc.

Date: 1986
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://doi.org/10.1002/(SICI)1097-4571(198609)37:53.0.CO;2-5

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamest:v:37:y:1986:i:5:p:346-348

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1097-4571

Access Statistics for this article

More articles in Journal of the American Society for Information Science from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().