On a New Measure of Classifier Competence Applied to the Design of Multiclassifier Systems

Authors:
Tomasz Woloszynski;Marek Kurzynski
Affiliations:
Chair of Systems and Computer Networks, Wroclaw University of Technology, Wroclaw, Poland 50-370;Chair of Systems and Computer Networks, Wroclaw University of Technology, Wroclaw, Poland 50-370
Venue:
ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
Year:
2009

Citing 5
Cited 2

Combination of Multiple Classifiers Using Local Accuracy Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
From dynamic classifier selection to dynamic ensemble selection

Pattern Recognition
Rapid and brief communication: A study on the performances of dynamic classifier selection based on local accuracy estimation

Pattern Recognition

A probabilistic model of classifier competence for dynamic ensemble selection

Pattern Recognition
A measure of competence based on random classification for dynamic ensemble selection

Information Fusion

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a new method for calculating competence of a classifier in the feature space. The idea is based on relating the response of the classifier with the response obtained by a random guessing. The measure of competence reflects this relation and rates the classifier with respect to the random guessing in a continuous manner. Two multiclassifier systems representing fusion and selection strategies were developed using proposed measure of competence. The performance of multiclassifiers was evaluated using five benchmark databases from the UCI Machine Learning Repository and Ludmila Kuncheva Collection. Classification results obtained for three simple fusion methods and one multiclassifier system with selection strategy were used for a comparison. The experimental results showed that, regardless of the strategy used by the multiclassifier system, the classification accuracy has increased when the measure of competence was employed. The improvement was most significant for simple fusion methods (sum, product and majority vote ). For all databases, two developed multiclassifier systems produced the best classification scores.