Discovering latent topical structure by second‐order similarity analysis

Timothy Cribbin

Journal of the American Society for Information Science and Technology, 2011, vol. 62, issue 6, 1188-1207

Abstract: Computing document similarity directly from a “bag of words” vector space model can be problematic because term independence causes the relationships between synonymous terms and the contextual influences that determine the sense of polysemous terms to be ignored. This study compares two methods that potentially address these problems by deriving the higher order relationships that lie latent within the original first‐order space. The first is latent semantic analysis (LSA), a dimension reduction method that is a well‐known means of addressing the vocabulary mismatch problem in information retrieval systems. The second is the lesser known yet conceptually simple approach of second‐order similarity (SOS) analysis, whereby latent similarity is measured in terms of mutual first‐order similarity. Nearest neighbour tests show that SOS analysis derives similarity models that are superior to both first‐order and LSA‐derived models at both coarse and fine levels of semantic granularity. SOS analysis has been criticized for its computational complexity. A second contribution is the novel application of vector truncation to reduce run‐time by a constant factor. Speed‐ups of 4 to 10 times are achievable without compromising the structural gains achieved by full‐vector SOS analysis.

Date: 2011
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.1002/asi.21519

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jamist:v:62:y:2011:i:6:p:1188-1207

Ordering information: This journal article can be ordered from
https://doi.org/10.1002/(ISSN)1532-2890

Access Statistics for this article

More articles in Journal of the American Society for Information Science and Technology from Association for Information Science & Technology
Bibliographic data for series maintained by Wiley Content Delivery ().