BERTERS: Multimodal representation learning for expert recommendation system with transformers and graph embeddings

N. Nikzad-Khasmakhi, M.A. Balafar, M. Reza Feizi-Derakhshi and Cina Motamed

Chaos, Solitons & Fractals, 2021, vol. 151, issue C

Abstract: An expert recommendation system suggests relevant experts of a particular topic based on three different scores authority, text similarity, and reputation. Most of the previous studies individually compute these scores and join them with a linear combination strategy. While, in this paper, we introduce a transfer learning-based and multimodal approach, called BERTERS, that presents each expert candidate by a single vector representation that includes these scores in itself. BERTERS determines a representation for each candidate that presents the candidate’s level of knowledge, popularity and influence, and history. BERTERS directly uses both transformers and the graph embedding techniques to convert the content published by candidates and collaborative relationships between them into low-dimensional vectors which show the candidates’ text similarity and authority scores. Also, to enhance the accuracy of recommendation, BERTERS takes into account additional features as reputation score. We conduct extensive experiments over the multi-label classification, recommendation, and visualization tasks. Also, we assess its performance on four different classifiers, diverse train ratios, and various embedding sizes. In the classification task, BERTERS strengthens the performance on Micro-F1 and Macro-F1 metrics by 23.40% and 34.45% compared with single-modality based methods. Furthermore, BERTERS achieves a gain of 9.12% in comparison with the baselines. Also, the results prove the capability of BERTERS to extend into a variety of domains such as academic and CQA to find experts. Since our proposed expert embeddings contain rich semantic and syntactic information of the candidate, BERTERS resulted in significantly improved performance over the baselines in all tasks.

Keywords: Multimodal representation learning; Expert recommendation system; Transformer; Graph embedding (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077921006147
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:151:y:2021:i:c:s0960077921006147

DOI: 10.1016/j.chaos.2021.111260

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().