DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

Fangling Leng, Fan Li (), Yubin Bao, Tiancheng Zhang and Ge Yu
Additional contact information
Fangling Leng: School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China
Fan Li: School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China
Yubin Bao: School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China
Tiancheng Zhang: School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China
Ge Yu: School of Computer Science and Engineering, Northeastern University, Shenyang 110169, China

Mathematics, 2024, vol. 12, issue 13, 1-15

Abstract: Regarding the existing models for feature extraction of complex similar entities, there are problems in the utilization of relative position information and the ability of key feature extraction. The distinctiveness of Chinese named entity recognition compared to English lies in the absence of space delimiters, significant polysemy and homonymy of characters, diverse and common names, and a greater reliance on complex contextual and linguistic structures. An entity recognition method based on DeBERTa-Attention-BiLSTM-CRF (DABC) is proposed. Firstly, the feature extraction capability of the DeBERTa model is utilized to extract the data features; then, the attention mechanism is introduced to further enhance the extracted features; finally, BiLSTM is utilized to further capture the long-distance dependencies in the text and obtain the predicted sequences through the CRF layer, and then the entities in the text are identified. The proposed model is applied to the dataset for validation. The experiments show that the precision ( P ) of the proposed DABC model on the dataset reaches 88.167%, the recall ( R ) reaches 83.121%, and the F 1 value reaches 85.024%. Compared with other models, the F 1 value improves by 3∼5%, and the superiority of the model is verified. In the future, it can be extended and applied to recognize complex entities in more fields.

Keywords: DeBERTa; multi-attention mechanism; BiLSTM-CRF; named entity recognition (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/13/1992/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/13/1992/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:13:p:1992-:d:1423979

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().