A Quantum Language-Inspired Tree Structural Text Representation for Semantic Analysis

Yan Yu, Dong Qiu and Ruiteng Yan
Additional contact information
Yan Yu: School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
Dong Qiu: College of Science, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
Ruiteng Yan: School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

Mathematics, 2022, vol. 10, issue 6, 1-21

Abstract: Text representation is an important topic in the field of natural language processing, which can effectively transfer knowledge to downstream tasks. To extract effective semantic information from text with unsupervised methods, this paper proposes a quantum language-inspired tree structural text representation model to study the correlations between words with variable distance for semantic analysis. Combining the different semantic contributions of associated words in different syntax trees, a syntax tree-based attention mechanism is established to highlight the semantic contributions of non-adjacent associated words and weaken the semantic weight of adjacent non-associated words. Moreover, the tree-based attention mechanism includes not only the overall information of entangled words in the dictionary but also the local grammatical structure of word combinations in different sentences. Experimental results on semantic textual similarity tasks show that the proposed method obtains significant performances over the state-of-the-art sentence embeddings.

Keywords: natural language processing; syntax tree; attention mechanism; semantic analysis; quantum language-inspired (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/6/914/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/6/914/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:6:p:914-:d:770110

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().