A Dynamic Attention and Multi-Strategy-Matching Neural Network Based on Bert for Chinese Rice-Related Answer Selection

Haoriqin Wang, Huarui Wu, Qinghu Wang, Shicheng Qiao, Tongyu Xu and Huaji Zhu
Additional contact information
Haoriqin Wang: School of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, China
Huarui Wu: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
Qinghu Wang: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Shicheng Qiao: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Tongyu Xu: School of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang 110866, China
Huaji Zhu: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China

Agriculture, 2022, vol. 12, issue 2, 1-17

Abstract: To allow the intelligent detection of correct answers in the rice-related question-and-answer (Q&A) communities of the “China Agricultural Technology Extension Information Platform”, we propose an answer selection model with dynamic attention and multi-strategy matching (DAMM). According to the characteristics of the rice-related dataset, the twelve-layer Chinese Bert pre-training model was employed to vectorize the text data and was compared with Word2vec, GloVe, and TF-IDF (Term Frequency–Inverse Document Frequency) methods. It was concluded that Bert could effectively solve the agricultural text’s high dimensionality and sparsity problems. As well as the problem of polysemy having different meanings in different contexts, dynamic attention with two different filtering strategies was used in the attention layer to effectively remove the sentence’s noise. The sentence representation of question-and-answer sentences was obtained. Secondly, two matching strategies (Full matching and Attentive matching) were introduced in the matching layer to complete the interaction between sentence vectors. Thirdly, a bi-directional gated recurrent unit (BiGRU) network spliced the sentence vectors obtained from the matching layer. Finally, a classifier was employed to calculate the similarity of splicing vectors, and the semantic correlation between question-and-answer sentences was acquired. The experimental results showed that DAMM had the best performance in the rice-related answer selection dataset compared with the other six answer selection models, of which MAP (Mean Average Precision) and MRR (Mean Reciprocal Rank) of DAMM gained 85.7% and 88.9%, respectively. Compared with the other six kinds of answer selection models, we present a new state-of-the-art method with the rice-related answer selection dataset.

Keywords: rice-related answer selection; natural language processing; dynamic attention and multi-strategy; question-and-answer communities (search for similar items in EconPapers)
JEL-codes: Q1 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2077-0472/12/2/176/pdf (application/pdf)
https://www.mdpi.com/2077-0472/12/2/176/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jagris:v:12:y:2022:i:2:p:176-:d:734883

Access Statistics for this article

Agriculture is currently edited by Ms. Leda Xuan

More articles in Agriculture from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().