Evaluation of n‐gram conflation approaches for Arabic text retrieval
Farag Ahmed and
Andreas Nürnberger
Journal of the American Society for Information Science and Technology, 2009, vol. 60, issue 7, 1448-1465
Abstract:
In this paper we present a language‐independent approach for conflation that does not depend on predefined rules or prior knowledge of the target language. The proposed unsupervised method is based on an enhancement of the pure n‐gram model that can group related words based on various string‐similarity measures, while restricting the search to specific locations of the target word by taking into account the order of n‐grams. We show that the method is effective to achieve high score similarities for all word‐form variations and reduces the ambiguity, i.e., obtains a higher precision and recall, compared to pure n‐gram‐based approaches for English, Portuguese, and Arabic. The proposed method is especially suited for conflation approaches in Arabic, since Arabic is a highly inflectional language. Therefore, we present in addition an adaptive user interface for Arabic text retrieval called “araSearch”. araSearch serves as a metasearch interface to existing search engines. The system is able to extend a query using the proposed conflation approach such that additional results for relevant subwords can be found automatically.
Date: 2009
References: Add references at CitEc
Citations:
Downloads: (external link)
https://doi.org/10.1002/asi.21063
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:60:y:2009:i:7:p:1448-1465
Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890
Access Statistics for this article
More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().