ResGAT: an improved graph neural network based on multi-head attention mechanism and residual network for paper classification

Xuejian Huang (), Zhibin Wu (), Gensheng Wang (), Zhipeng Li (), Yuansheng Luo () and Xiaofang Wu ()
Additional contact information
Xuejian Huang: Jiangxi University of Finance and Economics
Zhibin Wu: Jiangxi University of Finance and Economics
Gensheng Wang: Jiangxi University of Finance and Economics
Zhipeng Li: Jiangxi University of Finance and Economics
Yuansheng Luo: Jiangxi University of Finance and Economics
Xiaofang Wu: Jiangxi University of Finance and Economics

Scientometrics, 2024, vol. 129, issue 2, No 14, 1015-1036

Abstract: Abstract Paper classification plays a pivotal role in facilitating precise literature retrieval, recommendations, and bibliometric analyses. However, current text-based methods predominantly emphasize intrinsic features such as titles, abstracts, and keywords, overlooking the valuable insights concealed within reference papers (i.e., cited papers). As a result, this oversight leads to reduced classification accuracy. In contrast, as a practical deep learning approach, graph neural networks incorporate the characteristics of reference papers to enhance paper classification. Nevertheless, traditional graph neural networks encounter limitations when handling intricate multi-level citation relationships in academic papers. To address these challenges, we introduce an enhanced graph neural network model for academic paper classification. This model integrates a multi-head attention mechanism and a residual network structure to dynamically allocate weights to various nodes within the graph, thereby enhancing its ability to handle complex multi-level citation relationships. Our experimental findings on an extensive real-world dataset demonstrate that our model achieves an accuracy of 61%, surpassing traditional graph neural networks by over 4%. Additionally, we have made the relevant datasets and models accessible on our GitHub repository. ( https://github.com/xuejianhuang/ResGAT-for-paper-classification ).

Keywords: Graph neural network; Attention mechanism; Residual network; Deep Learning; Paper classification (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-023-04898-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:129:y:2024:i:2:d:10.1007_s11192-023-04898-w

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-023-04898-w

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().