MapReduce Based Information Retrieval Algorithms for Efficient Ranking of Webpages

Srinivasa K.G., Anil Kumar Muppalla, Bharghava Varun A. and Amulya M.
Additional contact information
Srinivasa K.G.: M.S. Ramaiah Institute of Technology, India
Anil Kumar Muppalla: M.S. Ramaiah Institute of Technology, India
Bharghava Varun A.: M.S. Ramaiah Institute of Technology, India
Amulya M.: M.S. Ramaiah Institute of Technology, India

International Journal of Information Retrieval Research (IJIRR), 2011, vol. 1, issue 4, 23-37

Abstract: In this paper, the authors discuss the MapReduce implementation of crawler, indexer and ranking algorithms in search engines. The proposed algorithms are used in search engines to retrieve results from the World Wide Web. A crawler and an indexer in a MapReduce environment are used to improve the speed of crawling and indexing. The proposed ranking algorithm is an iterative method that makes use of the link structure of the Web and is developed using MapReduce framework to improve the speed of convergence of ranking the WebPages. Categorization is used to retrieve and order the results according to the user choice to personalize the search. A new score is introduced in this paper that is associated with each WebPage and is calculated using user’s query and number of occurrences of the terms in the query in the document corpus. The experiments are conducted on Web graph datasets and the results are compared with the serial versions of crawler, indexer and ranking algorithms.

Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/ijirr.2011100102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jirr00:v:1:y:2011:i:4:p:23-37

Access Statistics for this article

International Journal of Information Retrieval Research (IJIRR) is currently edited by Zhongyu Lu

More articles in International Journal of Information Retrieval Research (IJIRR) from IGI Global
Bibliographic data for series maintained by Journal Editor ().