An Approach Based on Semantic Relationship Embeddings for Text Classification

Ana Laura Lezama-Sánchez, Mireya Tovar Vidal () and José A. Reyes-Ortiz ()
Additional contact information
Ana Laura Lezama-Sánchez: Faculty of Computer Science, Benemerita Universidad Autonoma de Puebla, Puebla 72570, Mexico
Mireya Tovar Vidal: Faculty of Computer Science, Benemerita Universidad Autonoma de Puebla, Puebla 72570, Mexico
José A. Reyes-Ortiz: System Department, Universidad Autonoma Metropolitana, Azcapotzalco 02200, Mexico

Mathematics, 2022, vol. 10, issue 21, 1-15

Abstract: Semantic relationships between words provide relevant information about the whole idea in the texts. Existing embedding representation models characterize each word as a vector of numbers with a fixed length. These models have been used in tasks involving text classification, such as recommendation and question–answer systems. However, the embedded information provided by semantic relationships has been neglected. Therefore, this paper proposes an approach that involves semantic relationships in embedding models for text classification, which is evaluated. Three embedding models based on semantic relations extracted from Wikipedia are presented and compared with existing word-based models. Our approach considers the following relationships: synonymy, hyponymy, and hyperonymy. They were considered since previous experiments have shown that they provide semantic knowledge. The relationships are extracted from Wikipedia using lexical-syntactic patterns identified in the literature. The extracted relationships are embedded as a vector: synonymy, hyponymy–hyperonymy, and a combination of all relationships. A Convolutional Neural Network using semantic relationship embeddings was trained for text classification. An evaluation was carried out for the proposed relationship embedding configurations and existing word-based models to compare them based on two corpora. The results were obtained with the metrics of precision, accuracy, recall, and F 1 -measure. The best results for the 20-Newsgroup corpus were obtained with the hyponymy–hyperonymy embeddings, achieving an accuracy of 0.79. For the Reuters corpus, F 1 -measure and recall of 0.87 were obtained using synonymy–hyponymy–hyperonymy.

Keywords: deep learning; semantic relationship embeddings; lexical syntactic patterns; convolutional neural networks; text classification (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/21/4161/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/21/4161/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:21:p:4161-:d:965586

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().