Can unbounded distance measures mitigate the curse of dimensionality?

Balasubramaniam Jayaram and Frank Klawonn

International Journal of Data Mining, Modelling and Management, 2012, vol. 4, issue 4, 361-383

Abstract: In this work, we revisit the curse of dimensionality, especially the concentration of the norm phenomenon which is the inability of distance functions to separate points well in high dimensions. We study the influence of the different properties of a distance measure, viz., triangle inequality, boundedness and translation invariance and on this phenomenon. Our studies indicate that unbounded distance measures whose expectations do not exist are to be preferred. We propose some new distance measures based on our studies and present many experimental results which seem to confirm our analysis. In particular, we study these distance measures w.r.t. indices like relative variance and relative contrast and further compare and contrast these measures in the setting of nearest neighbour/proximity searches and hierarchical clustering.

Keywords: curse of dimensionality; CoD; nearest neighbour classifier; cluster analysis; unbounded distance measures; triangle inequality; boundedness; translation invariance; classification; clustering. (search for similar items in EconPapers)
Date: 2012
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=49883 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijdmmm:v:4:y:2012:i:4:p:361-383

Access Statistics for this article

More articles in International Journal of Data Mining, Modelling and Management from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().