Research on Relation Classification Tasks Based on Cybersecurity Text

Ze Shi, Hongyi Li, Di Zhao () and Chengwei Pan ()
Additional contact information
Ze Shi: School of Cyber Science and Technology, Beihang University, Beijing 100191, China
Hongyi Li: School of Cyber Science and Technology, Beihang University, Beijing 100191, China
Di Zhao: School of Cyber Science and Technology, Beihang University, Beijing 100191, China
Chengwei Pan: Institute of Artificial Intelligence, Beihang University, Beijing 100191, China

Mathematics, 2023, vol. 11, issue 12, 1-16

Abstract: Relation classification is a significant task within the field of natural language processing. Its objective is to extract and identify relations between two entities in a given text. Within the scope of this paper, we construct an artificial dataset (CS13K) for relation classification in the realm of cybersecurity and propose two models for processing such tasks. For any sentence containing two target entities, we first locate the entities and fine-tune the pre-trained BERT model. Next, we utilize graph attention networks to iteratively update word nodes and relation nodes. A new relation classification model is constructed by concatenating the updated vectors of word nodes and relation nodes. Our proposed model achieved exceptional performance on the SemEval-2010 task 8 dataset, surpassing previous approaches with a remarkable F1 value of 92.3%. Additionally, we propose the integration of a ranking-based voting mechanism into the existing model. Our best results are an F1 value of 92.5% on the SemEval-2010 task 8 dataset and a value 94.6% on the CS13K dataset. These findings highlight the effectiveness of our proposed models in tackling relation classification tasks.

Keywords: relation classification; graph neural network; cybersecurity; natural language processing (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/12/2598/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/12/2598/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:12:p:2598-:d:1165216

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().