Nonparametric classification of high dimensional observations

Reza Modarres ()
Additional contact information
Reza Modarres: George Washington University

Statistical Papers, 2023, vol. 64, issue 6, No 2, 1833-1859

Abstract: Abstract We consider the nonparametric classification of high dimensional, low sample size (HDLSS) data where the classical discrimination methods break down due to the singularity of the sample covariance matrix. We present new dissimilarity indices, discuss their asymptotic properties in the HDLSS setting, use them in building powerful classifiers, and compare their behavior with existing methods. We illustrate the difficulties with the Euclidean nearest neighbor method and prove that dissimilarity-based classifiers produce misclassification rates that tend to zero as $$p\rightarrow \infty $$ p → ∞ . We present test-based classifiers in the HDLSS setting. A simulation study compares the misclassification rates of diagonal linear discriminant analysis with twelve other nonparametric classifiers. The methods are applied to microarray data for classification of prostate cancer.

Keywords: HDLSS; Dissimilarity index; Nearest neighbor; Test-based classifier; 62H30; 62G20; 62H15 (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-022-01363-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:64:y:2023:i:6:d:10.1007_s00362-022-01363-3

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-022-01363-3

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().