Evaluation of News Search Engines Based On Information Retrieval Models

Mohammad Ubaidullah Bokhari, Mohd. Kashif Adhami and Afaq Ahmad ()
Additional contact information
Mohammad Ubaidullah Bokhari: Aligarh Muslim University
Mohd. Kashif Adhami: Aligarh Muslim University
Afaq Ahmad: Sultan Qaboos University

SN Operations Research Forum, 2021, vol. 2, issue 3, 1-22

Abstract: Abstract News search engines are the exclusive search services for users’ news intake. Providing relevant query to a news search engine, the user gets back a single news result page consisting of various news articles aggregated from thousands of online news sources available on the World Wide Web. The availability and use of major news search engines like Bing news, Google news and Newslookup demand retrieval effectiveness evaluation of these search systems. In this paper, core retrieval models, namely, vector space model, Okapi BM25 and latent semantic indexing are used to evaluate retrieval effectiveness of news search engines for relevance effectiveness evaluation considering these models separately. Further, Monte-Carlo cross-entropy based rank aggregation technique is used to do more comprehensive relevance effectiveness evaluation by aggregating three individual rankings. Experimental results denote Google news’s performance to be better than the other two search engines.

Keywords: Retrieval effectiveness; Latent semantic indexing; Aggregation; Spearman rank order; Correlation coefficient; Kendall’s tau (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s43069-021-00081-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:snopef:v:2:y:2021:i:3:d:10.1007_s43069-021-00081-0

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/43069

DOI: 10.1007/s43069-021-00081-0

Access Statistics for this article

SN Operations Research Forum is currently edited by Marco Lübbecke

More articles in SN Operations Research Forum from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().