An Adaptive Mixup Hard Negative Sampling for Zero-Shot Entity Linking

Shisen Cai, Xi Wu, Maihemuti Maimaiti (), Yichang Chen, Zhixiang Wang and Jiong Zheng
Additional contact information
Shisen Cai: School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
Xi Wu: School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, China
Maihemuti Maimaiti: School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
Yichang Chen: School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
Zhixiang Wang: School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
Jiong Zheng: School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China

Mathematics, 2023, vol. 11, issue 20, 1-16

Abstract: Recently, the focus of entity linking research has centered on the zero-shot scenario, where the entity purposed to be labeled at the time of testing was never observed during the training phase, or it may belong to a different domain than the source domain. Current studies have used BERT as the base encoder, as it effectively establishes distributional links between source and target domains. The currently available negative sampling methods all use an extractive approach, which makes it difficult for the models to learn diverse and more challenging negative samples. To address this problem, we propose a generative negative sampling method, adaptive_mixup_hard, which generates more difficult negative entities by fusing the features of both positive and negative samples on top of hard negative sampling and introduces a transformable adaptive parameter, W , to increase the diversity of negative samples. Next, we fuse our method with the Biencoder architecture and evaluate its performance under three different score functions. Ultimately, experimental results on the standard benchmark dataset, Zeshel, demonstrate the effectiveness of our method.

Keywords: zero-shot; BERT; adaptive_mixup_hard; Biencoder; Zeshel (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/20/4366/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/20/4366/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:20:p:4366-:d:1263958

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().