A novel scalable multi-class ROC for effective visualization and computation

Authors:
Md. Rafiul Hassan;Kotagiri Ramamohanarao;Chandan Karmakar;M. Maruf Hossain;James Bailey
Affiliations:
Department of Computer Science and Software Engineering, The University of Melbourne, VIC, Australia;Department of Computer Science and Software Engineering, The University of Melbourne, VIC, Australia;Department of Electrical Engineering, The University of Melbourne, VIC, Australia;Department of Computer Science and Software Engineering, The University of Melbourne, VIC, Australia;Department of Computer Science and Software Engineering, The University of Melbourne, VIC, Australia
Venue:
PAKDD'10 Proceedings of the 14th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part I
Year:
2010

Citing 1
Cited 2

A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems

Machine Learning

ClasSi: measuring ranking quality in the presence of object classes with similarity information

PAKDD'11 Proceedings of the 15th international conference on New Frontiers in Applied Data Mining
RadialViz: an orientation-free frequent pattern visualizer

PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a new cost function for evaluating the multi-class classifier. The new cost function facilitates both a way to visualize the performance (expected cost) of the multi-class classifier and a summary of the misclassification costs. This function overcomes the limitations of ROC in not being able to represent the classifier performance graphically when there are more than two classes. Here we present a new scalable method for producing a scalar measurement that is used to compare the performance of the multi-class classifier. We mathematically demonstrate that our technique can capture small variations in classifier performance.