Key - Gram Extractions and Analyses of Different Registers Based on Attention Network

Haiyan Wu, Ying Liu, Shaoyun Shi, Qingfeng Wu and Yunlong Huang

Journal of Applied Mathematics, 2021, vol. 2021, 1-16

Abstract:

Key -gram extraction can be seen as extracting - grams which can distinguish different registers. Keyword (as , 1-gram is the keyword) extraction models are generally carried out from two aspects, the feature extraction and the model design. By summarizing the advantages and disadvantages of existing models, we propose a novel key - gram extraction model “attentive - gram network†(ANN) based on the attention mechanism and multilayer perceptron, in which the attention mechanism scores each - gram in a sentence by mining the internal semantic relationship between words, and their importance is given by the scores. Experimental results on the real corpus show that the key - gram extracted from our model can distinguish a novel , news , and text book very well; the accuracy of our model is significantly higher than the baseline model. Also, we conduct experiments on key - grams extracted from these registers, which turned out to be well clustered. Furthermore, we make some statistical analyses of the results of key - gram extraction. We find that the key - grams extracted by our model are very explanatory in linguistics.

Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://downloads.hindawi.com/journals/JAM/2021/5264090.pdf (application/pdf)
http://downloads.hindawi.com/journals/JAM/2021/5264090.xml (text/xml)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hin:jnljam:5264090

DOI: 10.1155/2021/5264090

Access Statistics for this article

More articles in Journal of Applied Mathematics from Hindawi
Bibliographic data for series maintained by Mohamed Abdelhakeem ().