Mining Supervised Classification Performance Studies: A Meta-Analytic Investigation

Authors:
Adrien Jamain;David J. Hand
Affiliations:
BNP-Paribas, London, UK NW1 6AA;Department of Mathematics, and Institute for Mathematical Sciences, Imperial College, London, UK SW7 2AZ
Venue:
Journal of Classification
Year:
2008

Citing 0
Cited 8

Measuring classifier performance: a coherent alternative to the area under the ROC curve

Machine Learning
Classification by clustering decision tree-like classifier based on adjusted clusters

Expert Systems with Applications: An International Journal
Classification by clustering decision tree-like classifier based on adjusted clusters

Expert Systems with Applications: An International Journal
A decision support method, based on bounded rationality concepts, to reveal feature saliency in clustering problems

Decision Support Systems
Efficacious end user measures part 1: relative class size and end user problem domains

Advances in Artificial Intelligence - Special issue on Artificial Intelligence Applications in Biomedicine
A comparative analysis of classification algorithms in data mining for accuracy, speed and robustness

Information Technology and Management
One class random forests

Pattern Recognition
Hybrid decision tree and naïve Bayes classifiers for multi-class classification tasks

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

There have been many comparative studies of classification methods in which real datasets are used as a gauge to assess the relative performance of the methods. Since these comparisons often yield inconclusive or limited results on how methods perform, it is often believed that a broader approach combining these studies would shed some light on this difficult question. This paper describes such an attempt: we have sampled the available literature and created a dataset of 5807 classification results. We show that one of the possible ways to analyze the resulting data is an overall assessment of the classification methods, and we present methods for that particular aim. The merits and demerits of such an approach are discussed, and conclusions are drawn which may assist future research: we argue that the current state of the literature hardly allows large-scale investigations.