A Contrastive Model with Local Factor Clustering for Semi-Supervised Few-Shot Learning

Hexiu Lin, Yukun Liu, Daming Shi () and Xiaochun Cheng
Additional contact information
Hexiu Lin: College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China
Yukun Liu: College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China
Daming Shi: College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China
Xiaochun Cheng: Faculty of Science and Technology, Middlesex University, Hendon, London NW4 4BT, UK

Mathematics, 2023, vol. 11, issue 15, 1-13

Abstract: Learning novel classes with a few samples per class is a very challenging task in deep learning. To mitigate this issue, previous studies have utilized an additional dataset with extensively labeled samples to realize transfer learning. Alternatively, many studies have used unlabeled samples that originated from the novel dataset to achieve few-shot learning, i.e., semi-supervised few-shot learning. In this paper, an easy but efficient semi-supervised few-shot learning model is proposed to address the embeddings mismatch problem that results from inconsistent data distributions between the novel and base datasets, where samples with the same label approach each other while samples with different labels separate from each other in the feature space. This model emphasizes pseudo-labeling guided contrastive learning. We also develop a novel local factor clustering module to improve the ability to obtain pseudo-labels from unlabeled samples, and this module fuses the local feature information of labeled and unlabeled samples. We report our experimental results on the mini-ImageNet and tiered-ImageNet datasets for both five-way one-shot and five-way five-shot settings and achieve better performance than previous models. In particular, the classification accuracy of our model is improved by approximately 11.53% and 14.87% compared to the most advanced semi-supervised few-shot learning model we know in the five-way one-shot scenario. Moreover, ablation experiments in this paper show that our proposed clustering strategy demonstrates accuracy improvements of about 4.00% in the five-way one-shot and five-way five-shot scenarios compared to two popular clustering methods.

Keywords: few-shot learning; clustering; semi-supervised learning; local features; contrastive learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/15/3394/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/15/3394/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:15:p:3394-:d:1210004

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().