Kernel-free Reduced Quadratic Surface Support Vector Machine with 0-1 Loss Function and L $$_p$$ p -norm Regularization

Mingyang Wu () and Zhixia Yang ()
Additional contact information
Mingyang Wu: Xinjiang University
Zhixia Yang: Xinjiang University

Annals of Data Science, 2025, vol. 12, issue 1, No 15, 412 pages

Abstract: Abstract This paper presents a novel nonlinear binary classification method, namely the kernel-free reduced quadratic surface support vector machine with 0-1 loss function and L $$_{p}$$ p -norm regularization (L $$_p$$ p -RQSSVM $$_{0/1}$$ 0 / 1 ). It uses kernel-free trick aimed at finding a reduced quadratic surface to separate samples, without considering the cross terms in quadratic form. This saves computational costs and provides better interpretability than methods using kernel functions. In addition, adding the 0-1 loss function and L $$_p$$ p -norm regularization to construct our L $$_p$$ p -RQSSVM $$_{0/1}$$ 0 / 1 enables sample sparsity and feature sparsity. The support vector (SV) of L $$_p$$ p -RQSSVM $$_{0/1}$$ 0 / 1 is defined, and it is derived that all SVs fall on the support hypersurfaces. Moreover, the optimality condition is explored theoretically, and a new iterative algorithm based on the alternating direction method of multipliers (ADMM) framework is used to solve our L $$_p$$ p -RQSSVM $$_{0/1}$$ 0 / 1 on the selected working set. The computational complexity and convergence of the algorithm are discussed. Furthermore, numerical experiments demonstrate that our L $$_p$$ p -RQSSVM $$_{0/1}$$ 0 / 1 achieves better classification accuracy, less SVs, and higher computational efficiency than other methods on most datasets. It also has feature sparsity under certain conditions.

Keywords: Reduced quadratic surface; Kernel-free; Binary classification; Sparsity; 0-1 loss function (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s40745-024-00573-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:aodasc:v:12:y:2025:i:1:d:10.1007_s40745-024-00573-w

Ordering information: This journal article can be ordered from
https://www.springer ... gement/journal/40745

DOI: 10.1007/s40745-024-00573-w

Access Statistics for this article

Annals of Data Science is currently edited by Yong Shi

More articles in Annals of Data Science from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().