A Residual LSTM and Seq2Seq Neural Network Based on GPT for Chinese Rice-Related Question and Answer System

Haoriqin Wang, Huarui Wu, Huaji Zhu, Yisheng Miao, Qinghu Wang, Shicheng Qiao, Haiyan Zhao, Cheng Chen and Jingjian Zhang
Additional contact information
Haoriqin Wang: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Huarui Wu: Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China
Huaji Zhu: Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China
Yisheng Miao: Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China
Qinghu Wang: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Shicheng Qiao: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Haiyan Zhao: College of Computer Science and Technology, Inner Mongolia Minzu University, Tongliao 028043, China
Cheng Chen: Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China
Jingjian Zhang: CangZhou Academy of Agriculture and Forestry Sciences, Cangzhou 061001, China

Agriculture, 2022, vol. 12, issue 6, 1-19

Abstract: Rice has a wide planting area as one of the essential food crops in China. The problem of diseases and pests in rice production has always been one of the main factors affecting its quality and yield. It is essential to provide treatment methods and means for rice diseases and pests quickly and accurately in the production process. Therefore, we used the rice question-and-answer (Q&A) community as an example. This paper aimed at the critical technical problems faced by the agricultural Q&A community: the accuracy of the existing agricultural Q&A model is low, which is challenging to meet users’ requirements to obtain answers in real-time in the production process. A network based on Attention-ResLSTM-seq2seq was used to realize the construction of the rice question and answer model. Firstly, the text presentation of rice question-and-answer pairs was obtained using the GPT pre-training model based on a 12-layer transformer. Then, ResLSTM(Residual Long Short-Term Memory) was used to extract text features in the encoder and decoder, and the output project matrix and output gate of LSTM were used to control the spatial information flow. When the network contacts the optimal state, the network only retains the constant mapping value of the input vector, which effectually reduces the network parameters and increases the network performance. Next, the attention mechanism was connected between the encoder and the decoder, which can effectually strengthen the weight of the keyword feature information of the question. The results showed that the BLEU and ROUGE of the Attention-ResLSTM-Seq2seq model reached the highest scores, 35.3% and 37.8%, compared with the other six rice-related generative question answering models.

Keywords: rice-related question and answer; Residual Long Short-Term Memory; question-and-answer communities; seq2seq (search for similar items in EconPapers)
JEL-codes: Q1 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2077-0472/12/6/813/pdf (application/pdf)
https://www.mdpi.com/2077-0472/12/6/813/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jagris:v:12:y:2022:i:6:p:813-:d:831520

Access Statistics for this article

Agriculture is currently edited by Ms. Leda Xuan

More articles in Agriculture from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().