TREC chemical information retrieval - An initial evaluation effort for chemical IR systems

Mihai Lupu, Jimmy Huang, Jianhan Zhu and John Tait

World Patent Information, 2011, vol. 33, issue 3, 248-256

Abstract: There is little need to emphasize the importance of chemoinformatics and chemical information retrieval. However, what seems to require a lot more effort in convincing members of the community is the need for standardized evaluation procedures and measures. How confident are we, as users, that the search tools we used have given us all the information that we were looking for? It is unrealistic to believe a marketing campaign which claims that a specific patent IR (information retrieval) system can find all relevant results for a search topic. And if we don't trust marketing campaigns, how can we get an idea of what to expect from a patent search engine? One of the most prominent initiatives to work in this direction, of evaluating chemical IR tools, has started in 2009 with the support of NIST (National Institute for Standards and Technology): the TREC Chemical IR Track focuses on evaluation of search technologies for retrieval and knowledge discovery of digitally stored information on chemical patents and academic journal articles on chemistry. This paper describes our 2009 experience, presents the official results of the participating groups, and lays down the targets for 2010.

Keywords: TREC; Chemical; IR; Patent; retrieval; Evaluation; Measures (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0172219011000536
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:worpat:v:33:y:2011:i:3:p:248-256

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
http://www.elsevier. ... _01_ooc_1&version=01

Access Statistics for this article

World Patent Information is currently edited by Michael Blackman

More articles in World Patent Information from Elsevier
Bibliographic data for series maintained by Catherine Liu ().