Sum Versus Vote Fusion in Multiple Classifier Systems

Authors:
J. Kittler;F. M. Alkoot
Affiliations:
-;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2003

Citing 9
Cited 52

Building a new generation of handwriting recognition systems

Pattern Recognition Letters - Postal processing and character recognition
Decision Combination in Multiple Classifier Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence
Bagging predictors

Machine Learning
On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Experimental evaluation of expert fusion strategies

Pattern Recognition Letters - Special issue on pattern recognition in practice VI
An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization

Machine Learning
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Comparison of Face Verification Results on the XM2VTS Database

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Application of majority voting to pattern recognition: an analysis of its behavior and performance

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

An evolutionary optimization approach for 3D human head model classification

MIR '03 Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval
Real-Time Gesture Recognition by Learning and Selective Control of Visual Interest Points

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence
Combining email models for false positive reduction

Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
A Biometric Identification System Based on Eigenpalm and Eigenfinger Features

IEEE Transactions on Pattern Analysis and Machine Intelligence
Voice-based gender identification in multimedia applications

Journal of Intelligent Information Systems - Special issue: Intelligent multimedia applications
Approaches to Multisensor Data Fusion in Target Tracking: A Survey

IEEE Transactions on Knowledge and Data Engineering
On the impact of fusion strategies on classification errors for large ensembles of classifiers

Pattern Recognition
A comparative study of combining multiple enrolled samples for fingerprint verification

Pattern Recognition
An experimental evaluation of ensemble methods for EEG signal classification

Pattern Recognition Letters
Ensemble methods for anomaly detection and distributed intrusion detection in Mobile Ad-Hoc Networks

Information Fusion
Face recognition incorporating ancillary information

EURASIP Journal on Advances in Signal Processing
Confidence based multiple classifier fusion in speaker verification

Pattern Recognition Letters
Decision tool for the early diagnosis of trauma patient hypovolemia

Journal of Biomedical Informatics
A Novel Biometric Personal Verification System Based on the Combination of Palmprints and Faces

Informatica
Investigating methods for improving bagged k-NN classifiers

AIKED'08 Proceedings of the 7th WSEAS International Conference on Artificial intelligence, knowledge engineering and data bases
Fusers Based on Classifier Response and Discriminant Function --- Comparative Study

HAIS '08 Proceedings of the 3rd international workshop on Hybrid Artificial Intelligence Systems
Combining multiple scoring systems for target tracking using rank-score characteristics

Information Fusion
Optimal weighting of bimodal biometric information with specific application to audio-visual person identification

Information Fusion
A genetic encoding approach for learning methods for combining classifiers

Expert Systems with Applications: An International Journal
Analysis of a Plurality Voting-based Combination of Classifiers

Neural Processing Letters
ASR based pronunciation evaluation with automatically generated competing vocabulary and classifier fusion

Speech Communication
Adaptive Splitting and Selection Method of Classifier Ensemble Building

HAIS '09 Proceedings of the 4th International Conference on Hybrid Artificial Intelligence Systems
Evolutionary discriminant feature extraction with application to face recognition

EURASIP Journal on Advances in Signal Processing - Special issue on recent advances in biometric systems: a signal processing perspective
Robust iris recognition algorithm for non-cooperative environment

International Journal of Biometrics
3D head model classification by evolutionary optimization of the Extended Gaussian Image representation

Pattern Recognition
Application of feature space trajectory classifier to identification of multi-aspect radar signals

Pattern Recognition
Bayesian analysis of linear combiners

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
On the diversity-performance relationship for majority voting in classifier ensembles

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
Linear combiners for classifier fusion: some theoretical and experimental results

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Multiple classifier fusion using k-nearest localized templates

IDEAL'07 Proceedings of the 8th international conference on Intelligent data engineering and automated learning
Hand-drawn face sketch recognition by humans and a PCA-based algorithm for forensic applications

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans - Special issue on recent advances in biometrics
Fingerprint classification based on subclass analysis using multiple templates of support vector machines

Intelligent Data Analysis
Active learning from stream data using optimal weight classifier ensemble

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Two-fold spatiotemporal regression modeling in wireless sensor networks

ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications - Volume Part II
A comparison of soft fusion methods under different bagging scenarios

CIMMACS'07 Proceedings of the 6th WSEAS international conference on Computational intelligence, man-machine systems and cybernetics
Combining multiagent negotiation and an interacting verification process to enhance biometric-based identification

BioID'11 Proceedings of the COST 2101 European conference on Biometrics and ID management
Characterizing spatially varying performance to improve multi-atlas multi-label segmentation

IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
An experimental study of one- and two-level classifier fusion for different sample sizes

Pattern Recognition Letters
Improvement of image transform calculation based on a weighted primitive

ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part I
Audio-Visual speaker identification via adaptive fusion using reliability estimates of both modalities

AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Markov chains pattern recognition approach applied to the medical diagnosis tasks

ISBMDA'05 Proceedings of the 6th International conference on Biological and Medical Data Analysis
A new ensemble method for gold mining problems: Predicting technology transfer

Electronic Commerce Research and Applications
Face verification with feature fusion of Gabor based and curvelet based representations

Multimedia Tools and Applications
Combining diverse one-class classifiers

HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part II
Combining classifiers under probabilistic models: experimental comparative analysis of methods

Expert Systems: The Journal of Knowledge Engineering
Improving protein-ATP binding residues prediction by boosting SVMs with random under-sampling

Neurocomputing
Classifier fusion with interval-valued weights

Pattern Recognition Letters
Opportunistic synergy: a classifier fusion engine for micro-gesture recognition

Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
A Lattice-Computing ensemble for reasoning based on formal fusion of disparate data types, and an industrial dispensing application

Information Fusion
A survey of multiple classifier systems as hybrid systems

Information Fusion
Feature ranking fusion for text classifier

Intelligent Data Analysis

Quantified Score

Hi-index	0.15

Visualization

Abstract

Amidst the conflicting experimental evidence of superiority of one over the other, we investigate the Sum and majority Vote combining rules in a two class case, under the assumption of experts being of equal strength and estimation errors conditionally independent and identically distributed. We show, analytically, that, for Gaussian estimation error distributions, Sum always outperforms Vote. For heavy tail distributions, we demonstrate by simulation that Vote may outperform Sum. Results on synthetic data confirm the theoretical predictions. Experiments on real data support the general findings, but also show the effect of the usual assumptions of conditional independence, identical error distributions, and common target outputs of the experts not being fully satisfied.