Mixed-Type Distance Shrinkage and Selection for Clustering via Kernel Metric Learning

Jesse S. Ghashti and John R. J. Thompson ()
Additional contact information
Jesse S. Ghashti: University of British Columbia
John R. J. Thompson: University of British Columbia

Journal of Classification, 2025, vol. 42, issue 2, No 3, 334 pages

Abstract: Abstract Distance-based clustering is widely used to group mixed numeric and categorical data (mixed-type data), where a predefined metric is used to quantify dissimilarity or distance between data points for clustering data. However, many existing metrics for mixed-type data convert continuous attributes to categorical attributes, or vice versa, and treat variables collectively as a single type, or calculate a distance between each variable separately and combine them. We propose a flexible kernel metric learning approach that balances numeric and categorical data types while determining which variables are relevant to dissimilarities within a dataset. The distance using kernel product similarity (DKPS) function uses kernel functions to measure similarity, with a maximum similarity cross-validated (MSCV) bandwidth selection technique that automatically scales and selects variables relevant to the underlying dissimilarities between data points. We prove that the DKPS function is a metric and show that the DKPS metric is a shrinkage method between maximum dissimilarity between all data points to uniform dissimilarity across data points. We demonstrate that when using the DKPS metric in various distance-based clustering algorithms, we improve clustering accuracy for simulated and real-world mixed-type datasets. In the context of clustering, we show that the DKPS metric with MSCV bandwidths is able to smooth out irrelevant variables and balance variables important to dissimilarity within mixed-type datasets.

Keywords: Mixed-type data; Metric learning; Distances; Clustering; Smoothing; Kernel methods; Bandwidth selection; Variable importance (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00357-024-09493-z Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jclass:v:42:y:2025:i:2:d:10.1007_s00357-024-09493-z

Ordering information: This journal article can be ordered from
http://www.springer. ... hods/journal/357/PS2

DOI: 10.1007/s00357-024-09493-z

Access Statistics for this article

Journal of Classification is currently edited by Douglas Steinley

More articles in Journal of Classification from Springer, The Classification Society
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().