A Generalized Linear Joint Trained Framework for Semi-Supervised Learning of Sparse Features

Juan Carlos Laria (), Line H. Clemmensen, Bjarne K. Ersbøll and David Delgado-Gómez
Additional contact information
Juan Carlos Laria: Department of Statistics, University Carlos III of Madrid, Calle Madrid 126, 28903 Getafe, Spain
Line H. Clemmensen: Department of Applied Mathematics and Computer Science, Technical University of Denmark, Düsternbrooker Weg 20, 24105 Lyngby, Denmark
Bjarne K. Ersbøll: Department of Applied Mathematics and Computer Science, Technical University of Denmark, Düsternbrooker Weg 20, 24105 Lyngby, Denmark
David Delgado-Gómez: Department of Statistics, University Carlos III of Madrid, Calle Madrid 126, 28903 Getafe, Spain

Mathematics, 2022, vol. 10, issue 16, 1-18

Abstract: The elastic net is among the most widely used types of regularization algorithms, commonly associated with the problem of supervised generalized linear model estimation via penalized maximum likelihood. Its attractive properties, originated from a combination of ℓ 1 and ℓ 2 norms, endow this method with the ability to select variables, taking into account the correlations between them. In the last few years, semi-supervised approaches that use both labeled and unlabeled data have become an important component in statistical research. Despite this interest, few researchers have investigated semi-supervised elastic net extensions. This paper introduces a novel solution for semi-supervised learning of sparse features in the context of generalized linear model estimation: the generalized semi-supervised elastic net (s 2 net), which extends the supervised elastic net method, with a general mathematical formulation that covers, but is not limited to, both regression and classification problems. In addition, a flexible and fast implementation for s 2 net is provided. Its advantages are illustrated in different experiments using real and synthetic data sets. They show how s 2 net improves the performance of other techniques that have been proposed for both supervised and semi-supervised learning.

Keywords: covariate shift; elastic net; semi-supervised classification; semi-supervised regression; unlabeled data (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/16/3001/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/16/3001/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:16:p:3001-:d:892799

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().