Sparse overlapped linear discriminant analysis

Youssef Anzarmou (), Abdallah Mkhadri () and Karim Oualkacha ()
Additional contact information
Youssef Anzarmou: University of Cadi Ayyad
Abdallah Mkhadri: University of Cadi Ayyad
Karim Oualkacha: Université du Québec à Montréal

TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, 2023, vol. 32, issue 1, No 15, 388-417

Abstract: Abstract High-dimensional binary discriminant analysis received most of the attention in the last years compared to the multi-class discriminant analysis. The latter is often considered as a generalization to the binary case and is thus usually treated as multiple binary classification problems. However, this results in classifiers that ignore multi-class structure features. On the other hand, known methods specifically tailored for the multi-class discriminant analysis either impose strong constrains such as the hard threshold, suffer from heavy computations due to conducting calculations only sequentially, or lack theoretical guarantees regarding the consistency of estimation and prediction. In this paper, a new sparse multi-class classification method, termed Sparse Overlapped Linear Discriminant Analysis, is proposed. It takes into account the multi-class information using an adaptive penalty whose weights reflect the multi-class structure. The new procedure estimates Bayes discriminant directions in a parallel way contrary to other methods which proceed only sequentially. It enjoys consistency results in the high-dimensional case in terms of estimation and prediction errors, and performs favorably compared to other competing methods on both simulated and real datasets.

Keywords: Categorical response; Linear discriminant analysis; Adaptive elastic net; High-dimensional data; 62H30; 62J07 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11749-022-00839-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:testjl:v:32:y:2023:i:1:d:10.1007_s11749-022-00839-6

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/11749/PS2

DOI: 10.1007/s11749-022-00839-6

Access Statistics for this article

TEST: An Official Journal of the Spanish Society of Statistics and Operations Research is currently edited by Alfonso Gordaliza and Ana F. Militino

More articles in TEST: An Official Journal of the Spanish Society of Statistics and Operations Research from Springer, Sociedad de Estadística e Investigación Operativa
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().