DEA-based internal validity index for clustering

Jing Zhao and Qingxian An

Journal of the Operational Research Society, 2025, vol. 76, issue 2, 280-293

Abstract: Internal validity indices are crucial in evaluating the quality of clustering results, serving as valuable tools for comparing various clustering algorithms and determining the optimal number of clusters for datasets. Most existing internal validity indices use the worst-case scenario to represent the overall validity. Moreover, some indices assign equal weights to distances among different clusters, even when these distances might have varying degrees of influence on the overall validity. Data envelopment analysis (DEA) is an effective technique for evaluating the performance of decision-making units through the computation of the ratio of the weighted sum of outputs to the weighted sum of inputs. The weight assigned to each indicator signifies its degree of influence on efficiency. Furthermore, DEA can be viewed as a multiple-criteria evaluation methodology, wherein inputs and outputs are two sets of performance criteria. We propose a DEA-based internal validity index (DEAI) to evaluate the validity of the clustering results. In this approach, intra-cluster compactness and inter-cluster separation are employed for determining the input(s) and output(s). The DEAI is then applied to the artificial datasets and empirical examples. Experimental results illustrate that DEAI outperforms six classic internal validity indices in accurately identifying the optimal cluster across all 10 datasets.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/01605682.2024.2348621 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tjorxx:v:76:y:2025:i:2:p:280-293

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tjor20

DOI: 10.1080/01605682.2024.2348621

Access Statistics for this article

Journal of the Operational Research Society is currently edited by Tom Archibald

More articles in Journal of the Operational Research Society from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().