DEEP QUALITY-CONSTRAINED LSTM FOR TEXTUAL DATA ANALYSIS

Linyu Li and Xiaoyu Luo
Additional contact information
Linyu Li: Foreign Language School, Shaoyang University, Shaoyang 422000, P. R. China
Xiaoyu Luo: Foreign Language School, Hunan University of Technology and Business, Changsha 410205, P. R. China

FRACTALS (fractals), 2022, vol. 30, issue 10, 1-10

Abstract: The creation of language models is a vital object of natural language processing because it creates a possible distribution in a sequence of words and offers a unique representation of each occurrence of a word. Therefore, an intelligent language model can differentiate the subtle nuances of language and model its syntax and semantics. It also allows the acquisition of high-level representations. In addition, it serves as an initial model with helpful information, which can be transferred to various other word processing methods for a deeper and more complete understanding of the language. This work proposes an innovative Long Short-Term Memory (LSTM) neural network whose implementation is based on the use of an attention mechanism as a measure of alignment of the output with the input sequence and a corresponding coverage optimization mechanism. The optimization mechanism informs the model about the possible outcomes at each step which have already been produced in previous actions. The adaptation and evaluation of the system’s design parameters were tested in multidimensional and challenging data sets We were considering parametric and heuristic procedures for finding the optimal combination of hyper-parameters. Experimental results demonstrate the quality of the proposed system, revealing essential directions for the design of similar systems.

Keywords: Machine Learning; Textual Data Analysis; Attention Mechanism; LSTM Network; Natural Language Processing (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0218348X2240268X
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:fracta:v:30:y:2022:i:10:n:s0218348x2240268x

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0218348X2240268X

Access Statistics for this article

FRACTALS (fractals) is currently edited by Tara Taylor

More articles in FRACTALS (fractals) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().