A Novel Maximum Mean Discrepancy-Based Semi-Supervised Learning Algorithm

Qihang Huang, Yulin He and Zhexue Huang
Additional contact information
Qihang Huang: Big Data Institute, College of Computer Science & Software Engineering, Shenzhen University, Shenzhen 518060, China
Yulin He: Big Data Institute, College of Computer Science & Software Engineering, Shenzhen University, Shenzhen 518060, China
Zhexue Huang: Big Data Institute, College of Computer Science & Software Engineering, Shenzhen University, Shenzhen 518060, China

Mathematics, 2021, vol. 10, issue 1, 1-19

Abstract: To provide more external knowledge for training self-supervised learning (SSL) algorithms, this paper proposes a maximum mean discrepancy-based SSL (MMD-SSL) algorithm, which trains a well-performing classifier by iteratively refining the classifier using highly confident unlabeled samples. The MMD-SSL algorithm performs three main steps. First, a multilayer perceptron (MLP) is trained based on the labeled samples and is then used to assign labels to unlabeled samples. Second, the unlabeled samples are divided into multiple groups with the k -means clustering algorithm. Third, the maximum mean discrepancy (MMD) criterion is used to measure the distribution consistency between k -means-clustered samples and MLP-classified samples. The samples having a consistent distribution are labeled as highly confident samples and used to retrain the MLP. The MMD-SSL algorithm performs an iterative training until all unlabeled samples are consistently labeled. We conducted extensive experiments on 29 benchmark data sets to validate the rationality and effectiveness of the MMD-SSL algorithm. Experimental results show that the generalization capability of the MLP algorithm can gradually improve with the increase of labeled samples and the statistical analysis demonstrates that the MMD-SSL algorithm can provide better testing accuracy and kappa values than 10 other self-training and co-training SSL algorithms.

Keywords: semi-supervised learning; maximum mean discrepancy; distribution consistency; self-training; co-training (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2021
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/1/39/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/1/39/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2021:i:1:p:39-:d:709429

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().