Keyword Extraction – Comparison of Latent Dirichlet Allocation and Latent Semantic Analysis

Bhuvaneshwari Kondeti, Jyothirani S. A and Haragopal V. V
Additional contact information
Bhuvaneshwari Kondeti: Osmania University, India
Jyothirani S. A: Osmania University, India
Haragopal V. V: BITS-Pilani, India

European Journal of Mathematics and Statistics, 2022, vol. 3, issue 3, 40-47

Abstract: The main aim of the present study is to compare the keywords extracted from abstracts and full length text of scientific research papers. In addition to that, here, we compare Latent Semantic Analysis (LSA) and Latent Dirichlet Allocation (LDA) to identify better performer for keyword extraction. This comparative study is divided into three levels, In the first level, scientific research articles on topics such as Indian Economic growth, GDP, Economic Slowdown etc. were collected and abstracts and full length text was extracted from the sources and pre-processed to remove the words and characters which were not useful to obtain the semantic structures or necessary patterns to make the meaningful corpus. In the second level, the pre-processed data were converted into a bag of words and numerical statistic TF-IDF (Term Frequency – Inverse Document Frequency) is used to assess how relevant a word is to a document in a corpus. In the third level, in order to study the feasibility of the Natural Language Processing (NLP) techniques, Latent Semantic analysis (LSA) and Latent Dirichlet Allocations (LDA) methods were applied over the resultant corpus.

Keywords: Keyword Extraction; Latent Dirichlet Allocation (LDA); Latent Semantic Analysis (LSA); Natural language Processing (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
https://eu-opensci.org/index.php/ejmath/article/view/14119 Abstract page (text/html)
https://eu-opensci.org/index.php/ejmath/article/download/14119/3171 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:epw:ejmath:v:3:y:2022:i:3:id:14119

DOI: 10.24018/ejmath.2022.3.3.119

Access Statistics for this article

More articles in European Journal of Mathematics and Statistics from European Open Science
Bibliographic data for series maintained by Support Team ().