Self-supervised scientific document recommendation based on contrastive learning

Shicheng Tan (), Tao Zhang (), Shu Zhao () and Yanping Zhang ()
Additional contact information
Shicheng Tan: Anhui University
Tao Zhang: University of Illinois at Chicago
Shu Zhao: Anhui University
Yanping Zhang: Anhui University

Scientometrics, 2023, vol. 128, issue 9, No 4, 5027-5049

Abstract: Abstract Scientific document recommendation aims to recommend scientific documents that have similar content to a given target scientific document (e.g., paper or patent, etc.). With the explosive growth in scientific documents, how recommending relevant scientific documents from the massive number of scientific documents has become an extremely challenging problem. Existing unsupervised scientific document recommendation works use generic approaches of text representation learning, ignoring the relationships between paragraphs within scientific documents, which is important for highly logical scientific documents. This paper proposes a self-supervised learning method, coupled text pair embedding (CTPE) model, which captures paragraph relations within scientific documents based on contrastive learning. First, we divide the scientific document into two parts. The two parts from the same document are positive samples, and these from different documents are negative samples. Then, we uncover the paragraph relations by contrasting intra-document and inter-document pairs such that intra pairs have the maximum agreement via a contrastive loss in the document embedding space. Finally, we propose a similarity calculation among document embeddings to achieve scientific document recommendations. We perform experiments on three datasets for one patent and two paper recommendation tasks. The experimental results verify the effectiveness of the proposed model. The proposed model can help researchers to efficiently discover relevant literature, foster interdisciplinary connections, and guide their research efforts in the scientometrics community. (The code is available at https://github.com/aitsc/text-representation .)

Keywords: Scientific document recommendation; Contrastive learning; Self-supervision learning (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-023-04782-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:128:y:2023:i:9:d:10.1007_s11192-023-04782-7

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-023-04782-7

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().