A survey of multiple classifier systems as hybrid systems

Authors:
Michał Woniak;Manuel Graña;Emilio Corchado
Affiliations:
-;-;-
Venue:
Information Fusion
Year:
2014

Citing 152
Cited 2

Intellectual issues in the history of artificial intelligence

The study of information: interdisciplinary messages
The Strength of Weak Learnability

Machine Learning
Multiple binary decision tree classifiers

Pattern Recognition
Original Contribution: Stacked generalization

Neural Networks
Decision Combination in Multiple Classifier Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence
An introduction to computational learning theory

An introduction to computational learning theory
A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals

IEEE Transactions on Pattern Analysis and Machine Intelligence
Methods for combining experts' probability assessments

Neural Computation
Boosting a weak learning algorithm by majority

Information and Computation
Bagging predictors

Machine Learning
Fab: content-based, collaborative recommendation

Communications of the ACM
Combination of Multiple Classifiers Using Local Accuracy Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Optimal linear combinations of neural networks

Neural Networks
A decision-theoretic generalization of on-line learning and an application to boosting

Journal of Computer and System Sciences - Special issue: 26th annual ACM symposium on the theory of computing & STOC'94, May 23–25, 1994, and second annual Europe an conference on computational learning theory (EuroCOLT'95), March 13–15, 1995
Partial Classification: The Benefit of Deferred Decision

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence
Boosting as entropy projection

COLT '99 Proceedings of the twelfth annual conference on Computational learning theory
Statistical Pattern Recognition: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Privacy-preserving data mining

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
A Framework for Collaborative, Content-Based and Demographic Filtering

Artificial Intelligence Review - Special issue on data mining on the Internet
Combination of neural and statistical algorithms for supervised classification of remote-sensing images

Pattern Recognition Letters
A streaming ensemble algorithm (SEA) for large-scale classification

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Handbook of Neural Network Signal Processing

Handbook of Neural Network Signal Processing
Random Forests

Machine Learning
Ensembling neural networks: many could be better than all

Artificial Intelligence
The computer and the brain

The computer and the brain
Hybrid Recommender Systems: Survey and Experiments

User Modeling and User-Adapted Interaction
User Modeling for Adaptive News Access

User Modeling and User-Adapted Interaction
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Sum Versus Vote Fusion in Multiple Classifier Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning Decision Lists

Machine Learning
The CN2 Induction Algorithm

Machine Learning
Queries and Concept Learning

Machine Learning
Queries and Concept Learning

Machine Learning
Diversity versus Quality in Classification Ensembles Based on Feature Selection

ECML '00 Proceedings of the 11th European Conference on Machine Learning
Detecting Concept Drift with Support Vector Machines

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Classification of Customer Call Data in the Presence of Concept Drift and Noise

Soft-Ware 2002 Proceedings of the First International Conference on Computing in an Imperfect World
Ensemble Methods in Machine Learning

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
A Cascaded Multiple Expert System for Verification

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
Combining One-Class Classifiers

MCS '01 Proceedings of the Second International Workshop on Multiple Classifier Systems
Complexity of Classification Problems and Comparative Advantages of Combined Classifiers

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
Classifier Combinations: Implementations and Theoretical Issues

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
Using Diversity in Preparing Ensembles of Classifiers Based on Different Feature Subsets to Minimize Generalization Error

EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Pruning Adaptive Boosting

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Optimizing a Multiple Classifier System

PRICAI '02 Proceedings of the 7th Pacific Rim International Conference on Artificial Intelligence: Trends in Artificial Intelligence
Random decision forests

ICDAR '95 Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 1) - Volume 1
Building decision tree classifier on private data

CRPIT '14 Proceedings of the IEEE international conference on Privacy, security and data mining - Volume 14
An Overview and Comparison of Voting Methods for Pattern Recognition

IWFHR '02 Proceedings of the Eighth International Workshop on Frontiers in Handwriting Recognition (IWFHR'02)
Dynamic Weighted Majority: A New Ensemble Method for Tracking Concept Drift

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Mining concept-drifting data streams using ensemble classifiers

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Novelty detection: a review—part 1: statistical approaches

Signal Processing
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
Combining diverse neural nets

The Knowledge Engineering Review
Probability Estimates for Multi-class Classification by Pairwise Coupling

The Journal of Machine Learning Research
Optimizing Nearest Neighbour in Random Subspaces using a Multi-Objective Genetic Algorithm

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Detection of land-cover transitions by combining multidate classifiers

Pattern Recognition Letters - Special issue: Pattern recognition for remote sensing (PRRS 2002)
Incorporating contextual information in recommender systems using a multidimensional approach

ACM Transactions on Information Systems (TOIS)
A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems

IEEE Transactions on Pattern Analysis and Machine Intelligence
Mining data streams: a review

ACM SIGMOD Record
Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random Forests for land cover classification

Pattern Recognition Letters - Special issue: Pattern recognition in remote sensing (PRRS 2004)
Effective classification of noisy data streams with attribute-oriented dynamic classifier selection

Knowledge and Information Systems
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
An analysis of diversity measures

Machine Learning
An automatic construction and organization strategy for ensemble learning on data streams

ACM SIGMOD Record
Managing Diversity in Regression Ensembles

The Journal of Machine Learning Research
Trainable fusion rules. I. Large sample size case

Neural Networks
Trainable fusion rules. II. Small sample-size effects

Neural Networks
Modeling intrusion detection system using hybrid intelligent systems

Journal of Network and Computer Applications - Special issue: Network and information security: A computational intelligence approach
Feature set decomposition for decision trees

Intelligent Data Analysis
An overview of anomaly detection techniques: Existing solutions and latest technological trends

Computer Networks: The International Journal of Computer and Telecommunications Networking
Soft computing system for bank performance prediction

Applied Soft Computing
Fingerprint classification using one-vs-all support vector machines dynamically ordered with naïve Bayes classifiers

Pattern Recognition
Classifier ensembles: Select real-world applications

Information Fusion
Dynamic integration of classifiers for handling concept drift

Information Fusion
Intrusion detection in computer networks by a modular ensemble of one-class classifiers

Information Fusion
Top 10 algorithms in data mining

Knowledge and Information Systems
From dynamic classifier selection to dynamic ensemble selection

Pattern Recognition
AptaCDSS-E: A classifier ensemble-based clinical decision support system for cardiovascular disease level prediction

Expert Systems with Applications: An International Journal
Improving the accuracy of an artificial neural network using multiple differently trained networks

Neural Computation
Adaptive mixtures of local experts

Neural Computation
Classification with a Reject Option using a Hinge Loss

The Journal of Machine Learning Research
Effects of feature construction on classification performance: An empirical study in bank failure prediction

Expert Systems with Applications: An International Journal
An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Diagnosis of valvular heart disease through neural networks ensembles

Computer Methods and Programs in Biomedicine
Effective diagnosis of heart disease through neural networks ensembles

Expert Systems with Applications: An International Journal
Constructing Ensembles from Data Envelopment Analysis

INFORMS Journal on Computing
Detection of malicious code by applying machine learning classifiers on static features: A state-of-the-art survey

Information Security Tech. Report
A comparison of approaches to large-scale data analysis

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Some Remarks on Chosen Methods of Classifier Fusion Based on Weighted Voting

HAIS '09 Proceedings of the 4th International Conference on Hybrid Artificial Intelligence Systems
Combining predictions in pairwise classification: An optimal adaptive voting strategy and its relation to weighted voting

Pattern Recognition
Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Computational Statistics & Data Analysis
Solving multiclass learning problems via error-correcting output codes

Journal of Artificial Intelligence Research
Genetic algorithms in classifier fusion

Applied Soft Computing
Support vector machine based multiagent ensemble learning for credit risk evaluation

Expert Systems with Applications: An International Journal
Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas

Pattern Analysis & Applications
Combination of Web page recommender systems

Expert Systems with Applications: An International Journal
Multiple classifier application to credit risk assessment

Expert Systems with Applications: An International Journal
Failure prediction of dotcom companies using neural network-genetic programming hybrids

Information Sciences: an International Journal
Introduction to Machine Learning

Introduction to Machine Learning
Letters: Ensemble of classifiers for protein fold recognition

Neurocomputing
Letters: Experimental comparison of one-class classifiers for online signature verification

Neurocomputing
Rapid and brief communication: A study on the performances of dynamic classifier selection based on local accuracy estimation

Pattern Recognition
Classification of multispectral images in coral environments using a hybrid of classifier ensembles

Neurocomputing
Bayesian analysis of linear combiners

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
Multi-category classification by soft-max combination of binary classifiers

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Combining predictions for accurate recommender systems

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions

Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions
An expert system for detecting automobile insurance fraud using social network analysis

Expert Systems with Applications: An International Journal
A self-trained ensemble with semisupervised SVM: An application to pixel classification of remote sensing imagery

Pattern Recognition
A data mining framework for detecting subscription fraud in telecommunication

Engineering Applications of Artificial Intelligence
Detection of financial statement fraud and feature selection using data mining techniques

Decision Support Systems
Data mining for credit card fraud: A comparative study

Decision Support Systems
An empirical study of classification algorithm evaluation for financial risk prediction

Applied Soft Computing
Change with Delayed Labeling: When is it Detectable?

ICDMW '10 Proceedings of the 2010 IEEE International Conference on Data Mining Workshops
An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes

Pattern Recognition
Feature-subspace aggregating: ensembles for stable and unstable learners

Machine Learning
Distributed denial of service attack detection using an ensemble of neural classifier

Computer Communications
Margin-based ensemble classifier for protein fold recognition

Expert Systems with Applications: An International Journal
Detecting fraud in online games of chance and lotteries

Expert Systems with Applications: An International Journal
A probabilistic model of classifier competence for dynamic ensemble selection

Pattern Recognition
Neurocognitive disorder detection based on feature vectors extracted from VBM analysis of structural MRI

Computers in Biology and Medicine
Complexity and multithreaded implementation analysis of one class-classifiers fuzzy combiner

HAIS'11 Proceedings of the 6th international conference on Hybrid artificial intelligent systems - Volume Part II
Decentralized distributed computing system for privacy-preserving combined classifiers: modeling and optimization

ICCSA'11 Proceedings of the 2011 international conference on Computational science and its applications - Volume Part I
Hybrid dendritic computing with kernel-LICA applied to Alzheimer's disease detection in MRI

Neurocomputing
Soft computing methods applied to combination of one-class classifiers

Neurocomputing
A hybrid recommender system for the selective dissemination of research resources in a Technology Transfer Office

Information Sciences: an International Journal
Anycasting in connection-oriented computer networks: Models, algorithms and results

International Journal of Applied Mathematics and Computer Science - Computational Intelligence in Modern Control Systems
Remote sensing image classification based on neural network ensemble algorithm

Neurocomputing
A hybrid ensemble approach for enterprise credit risk assessment based on Support Vector Machine

Expert Systems with Applications: An International Journal
A Two Stage Sequential Ensemble Applied to the Classification of Alzheimer's Disease Based on MRI Features

Neural Processing Letters
Cost-sensitive ensemble of support vector machines for effective detection of microcalcification in breast cancer diagnosis

FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II
Decoding visual brain states from fMRI using an ensemble of classifiers

Pattern Recognition
Naive random subspace ensemble with linear classifiers for real-time classification of fMRI data

Pattern Recognition
FLIPS: hybrid adaptive intrusion prevention

RAID'05 Proceedings of the 8th international conference on Recent Advances in Intrusion Detection
Anomalous payload-based worm detection and signature generation

RAID'05 Proceedings of the 8th international conference on Recent Advances in Intrusion Detection
A prescription fraud detection model

Computer Methods and Programs in Biomedicine
A measure of competence based on random classification for dynamic ensemble selection

Information Fusion
The impact of diversity on the accuracy of evidential classifier ensembles

International Journal of Approximate Reasoning
“Good” and “bad” diversity in majority vote ensembles

MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Classifiers selection in ensembles using genetic algorithms for bankruptcy prediction

Expert Systems with Applications: An International Journal
Stock fraud detection using peer group analysis

Expert Systems with Applications: An International Journal
Ensemble based sensing anomaly detection in wireless sensor networks

Expert Systems with Applications: An International Journal
Software, data and modelling news: imageRF - A user-oriented implementation for remote sensing image analysis with Random Forests

Environmental Modelling & Software
An efficient fuzzy classifier with feature selection based on fuzzyentropy

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Bagging k-dependence probabilistic networks: An alternative powerful fraud detection tool

Expert Systems with Applications: An International Journal
New results on error correcting output codes of kernel machines

IEEE Transactions on Neural Networks
Cost-Sensitive splitting and selection method for medical decision support system

IDEAL'12 Proceedings of the 13th international conference on Intelligent Data Engineering and Automated Learning
Information fusion techniques for change detection from multi-temporal remote sensing images

Information Fusion
A competitive ensemble pruning approach based on cross-validation technique

Knowledge-Based Systems
Combining cluster analysis with classifier ensembles to predict financial distress

Information Fusion

Clustering-based ensembles for one-class classification

Information Sciences: an International Journal
Hybrid extreme rotation forest

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

A current focus of intense research in pattern classification is the combination of several classifier systems, which can be built following either the same or different models and/or datasets building approaches. These systems perform information fusion of classification decisions at different levels overcoming limitations of traditional approaches based on single classifiers. This paper presents an up-to-date survey on multiple classifier system (MCS) from the point of view of Hybrid Intelligent Systems. The article discusses major issues, such as diversity and decision fusion methods, providing a vision of the spectrum of applications that are currently being developed.