Soft Label Guided Unsupervised Discriminative Sparse Subspace Feature Selection

Keding Chen, Yong Peng (), Feiping Nie and Wanzeng Kong
Additional contact information
Keding Chen: Hangzhou Dianzi University
Yong Peng: Hangzhou Dianzi University
Feiping Nie: Northwestern Polytechnical University
Wanzeng Kong: Hangzhou Dianzi University

Journal of Classification, 2024, vol. 41, issue 1, No 7, 129-157

Abstract: Abstract Feature selection and subspace learning are two primary methods to achieve data dimensionality reduction and discriminability enhancement. However, data label information is unavailable in unsupervised learning to guide the dimensionality reduction process. To this end, we propose a soft label guided unsupervised discriminative sparse subspace feature selection (UDS $$^2$$ 2 FS) model in this paper, which consists of two superiorities in comparison with the existing studies. On the one hand, UDS $$^2$$ 2 FS aims to find a discriminative subspace to simultaneously maximize the between-class data scatter and minimize the within-class scatter. On the other hand, UDS $$^2$$ 2 FS estimates the data label information in the learned subspace, which further serves as the soft labels to guide the discriminative subspace learning process. Moreover, the $$\ell _{2,0}$$ ℓ 2 , 0 -norm is imposed to achieve row sparsity of the subspace projection matrix, which is parameter-free and more stable compared to the $$\ell _{2,1}$$ ℓ 2 , 1 -norm. Experimental studies to evaluate the performance of UDS $$^2$$ 2 FS are performed from three aspects, i.e., a synthetic data set to check its iterative optimization process, several toy data sets to visualize the feature selection effect, and some benchmark data sets to examine the clustering performance of UDS $$^2$$ 2 FS. From the obtained results, UDS $$^2$$ 2 FS exhibits competitive performance in joint subspace learning and feature selection in comparison with some related models.

Keywords: Feature selection; Subspace learning; Soft label; Clustering; Joint optimization (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00357-024-09462-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jclass:v:41:y:2024:i:1:d:10.1007_s00357-024-09462-6

Ordering information: This journal article can be ordered from
http://www.springer. ... hods/journal/357/PS2

DOI: 10.1007/s00357-024-09462-6

Access Statistics for this article

Journal of Classification is currently edited by Douglas Steinley

More articles in Journal of Classification from Springer, The Classification Society
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().