Understanding latent semantic indexing: A topological structure analysis using Q‐analysis
Dandan Li and
Chung‐Ping Kwong
Journal of the American Society for Information Science and Technology, 2010, vol. 61, issue 3, 592-608
Abstract:
The method of latent semantic indexing (LSI) is well‐known for tackling the synonymy and polysemy problems in information retrieval; however, its performance can be very different for various datasets, and the questions of what characteristics of a dataset and why these characteristics contribute to this difference have not been fully understood. In this article, we propose that the mathematical structure of simplexes can be attached to a term‐document matrix in the vector space model (VSM) for information retrieval. The Q‐analysis devised by R.H. Atkin (1974) may then be applied to effect an analysis of the topological structure of the simplexes and their corresponding dataset. Experimental results of this analysis reveal that there is a correlation between the effectiveness of LSI and the topological structure of the dataset. By using the information obtained from the topological analysis, we develop a new method to explore the semantic information in a dataset. Experimental results show that our method can enhance the performance of VSM for datasets over which LSI is not effective.
Date: 2010
References: Add references at CitEc
Citations:
Downloads: (external link)
https://doi.org/10.1002/asi.21270
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:61:y:2010:i:3:p:592-608
Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890
Access Statistics for this article
More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().