On the Use of the Adjusted Rand Index as a Metric for Evaluating Supervised Classification

Authors:
Jorge M. Santos;Mark Embrechts
Affiliations:
ISEP - Instituto Superior de Engenharia do Porto, Portugal;Rensselaer Polytechnic Institute, Troy, New York, USA
Venue:
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part II
Year:
2009

Citing 4
Cited 1

What size net gives valid generalization?

Neural Computation
Support-Vector Networks

Machine Learning
Neural networks for pattern recognition

Neural networks for pattern recognition
An experimental comparison of performance measures for classification

Pattern Recognition Letters

Graph partitioning using improved ant clustering

ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Adjusted Rand Index (ARI) is frequently used in cluster validation since it is a measure of agreement between two partitions: one given by the clustering process and the other defined by external criteria. In this paper we investigate the usability of this clustering validation measure in supervised classification problems by two different approaches: as a performance measure and in feature selection. Since ARI measures the relation between pairs of dataset elements not using information from classes (labels) it can be used to detect problems with the classification algorithm specially when combined with conventional performance measures. Instead, if we use the class information, we can apply ARI also to perform feature selection. We present the results of several experiments where we have applied ARI both as a performance measure and for feature selection showing the validity of this index for the given tasks.