Towards a standard methodology to evaluate internal cluster validity indices

Authors:
Ibai Gurrutxaga;Javier Muguerza;Olatz Arbelaitz;Jesús M. Pérez;José I. Martín
Affiliations:
Department of Computer Architecture and Technology, University of the Basque Country, 20018 Donostia, Spain;Department of Computer Architecture and Technology, University of the Basque Country, 20018 Donostia, Spain;Department of Computer Architecture and Technology, University of the Basque Country, 20018 Donostia, Spain;Department of Computer Architecture and Technology, University of the Basque Country, 20018 Donostia, Spain;Department of Computer Architecture and Technology, University of the Basque Country, 20018 Donostia, Spain
Venue:
Pattern Recognition Letters
Year:
2011

Citing 14
Cited 2

Algorithms for clustering data

Algorithms for clustering data
On the number of clusters

Computational Statistics & Data Analysis - Special issue on classification
On finding the number of clusters

Pattern Recognition Letters
Applications of Data Mining in Computer Security

Applications of Data Mining in Computer Security
On Clustering Validation Techniques

Journal of Intelligent Information Systems
Performance Evaluation of Some Clustering Algorithms and Validity Indices

IEEE Transactions on Pattern Analysis and Machine Intelligence
A fuzzy hybrid hierarchical clustering method with a new criterion able to find the optimal partition

Fuzzy Sets and Systems - Clustering and modeling
Validation indices for graph clustering

Pattern Recognition Letters - Special issue: Graph-based representations in pattern recognition
A new cluster validity measure and its application to image compression

Pattern Analysis & Applications
Comparing clusterings: an axiomatic view

ICML '05 Proceedings of the 22nd international conference on Machine learning
New indices for cluster validity assessment

Pattern Recognition Letters
An objective approach to cluster validation

Pattern Recognition Letters
Characterization and evaluation of similarity measures for pairs of clusterings

Knowledge and Information Systems
A Cluster Separation Measure

IEEE Transactions on Pattern Analysis and Machine Intelligence

An extensive comparative study of cluster validity indices

Pattern Recognition
A comparison of clustering quality indices using outliers and noise

Intelligent Data Analysis

Quantified Score

Hi-index	0.10

Visualization

Abstract

The evaluation and comparison of internal cluster validity indices is a critical problem in the clustering area. The methodology used in most of the evaluations assumes that the clustering algorithms work correctly. We propose an alternative methodology that does not make this often false assumption. We compared 7 internal cluster validity indices with both methodologies and concluded that the results obtained with the proposed methodology are more representative of the actual capabilities of the compared indices.