Ensemble-based classifiers

Authors:
Lior Rokach
Affiliations:
Department of Information System Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
Venue:
Artificial Intelligence Review
Year:
2010

Citing 73
Cited 42

The Strength of Weak Learnability

Machine Learning
Multiple binary decision tree classifiers

Pattern Recognition
Evaluation of adaptive mixtures of competing experts

NIPS-3 Proceedings of the 1990 conference on Advances in neural information processing systems 3
Back propagation is sensitive to initial conditions

NIPS-3 Proceedings of the 1990 conference on Advances in neural information processing systems 3
The Meta-Pi Network: Building Distributed Knowledge Representations for Robust Multisource Pattern Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Original Contribution: Stacked generalization

Neural Networks
C4.5: programs for machine learning

C4.5: programs for machine learning
Technical Note: Selecting a Classification Method by Cross-Validation

Machine Learning
Hierarchical mixtures of experts and the EM algorithm

Neural Computation
Knowledge-based artificial neural networks

Artificial Intelligence
Recursive Automatic Bias Selection for Classifier Construction

Machine Learning - Special issue on bias evaluation and selection
Boosting a weak learning algorithm by majority

Information and Computation
Bagging predictors

Machine Learning
On the Accuracy of Meta-learning for Scalable Data Mining

Journal of Intelligent Information Systems
Combination of Multiple Classifiers Using Local Accuracy Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Graphical models for discovering knowledge

Advances in knowledge discovery and data mining
A new hybrid approach in combining multiple experts to recognise handwritten numerals

Pattern Recognition Letters
The Random Subspace Method for Constructing Decision Forests

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature selection for ensembles

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Cost complexity-based pruning of ensemble classifiers

Knowledge and Information Systems
Random Forests

Machine Learning
Ensembling neural networks: many could be better than all

Artificial Intelligence
A Survey of Methods for Scaling Up Inductive Algorithms

Data Mining and Knowledge Discovery
Using Correspondence Analysis to Combine Classifiers

Machine Learning
Pasting Small Votes for Classification in Large Databases and On-Line

Machine Learning
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants

Machine Learning
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature Transformation by Function Decomposition

IEEE Intelligent Systems
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy

Machine Learning
Rule Induction with CN2: Some Recent Improvements

EWSL '91 Proceedings of the European Working Session on Machine Learning
Problem Decomposition and the Learning of Skills

ECML '95 Proceedings of the 8th European Conference on Machine Learning
Variance Optimized Bagging

ECML '02 Proceedings of the 13th European Conference on Machine Learning
Using Rough Sets Theory and Database Operations to Construct a Good Ensemble of Classifiers for Data Mining Applications

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Improving Supervised Learning by Feature Decomposition

FoIKS '02 Proceedings of the Second International Symposium on Foundations of Information and Knowledge Systems
Combining Decision Trees and Neural Networks for Drug Discovery

EuroGP '02 Proceedings of the 5th European Conference on Genetic Programming
An Empirical Comparison of Pruning Methods for Ensemble Classifiers

IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
Pruning Adaptive Boosting

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Ensemble Feature election with the Simple Bayesian Classification in Medical Diagnostics

CBMS '02 Proceedings of the 15th IEEE Symposium on Computer-Based Medical Systems (CBMS'02)
Is Combining Classifiers with Stacking Better than Selecting the Best One?

Machine Learning
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
A cluster ensembles framework

Design and application of hybrid intelligent systems
Learning Ensembles from Bites: A Scalable and Accurate Approach

The Journal of Machine Learning Research
Ensemble selection from libraries of models

ICML '04 Proceedings of the twenty-first international conference on Machine learning
The Dynamics of AdaBoost: Cyclic Behavior and Convergence of Margins

The Journal of Machine Learning Research
Decomposition Methodology For Knowledge Discovery And Data Mining: Theory And Applications (Machine Perception and Artificial Intelligence)

Decomposition Methodology For Knowledge Discovery And Data Mining: Theory And Applications (Machine Perception and Artificial Intelligence)
Decomposition methodology for classification tasks: a meta decomposer framework

Pattern Analysis & Applications
A Comparison of Decision Tree Ensemble Creation Techniques

IEEE Transactions on Pattern Analysis and Machine Intelligence
Classifier evaluation under limited resources

Pattern Recognition Letters
Parallelizing AdaBoost by weights dynamics

Computational Statistics & Data Analysis
Feature set decomposition for decision trees

Intelligent Data Analysis
Ensemble Pruning Via Semi-definite Programming

The Journal of Machine Learning Research
Nonlinear Boosting Projections for Ensemble Construction

The Journal of Machine Learning Research
Decision-tree instance-space decomposition with grouped gain-ratio

Information Sciences: an International Journal
Cost-sensitive boosting for classification of imbalanced data

Pattern Recognition
EROS: Ensemble rough subspaces

Pattern Recognition
A local boosting algorithm for solving classification problems

Computational Statistics & Data Analysis
Genetic algorithm-based feature set partitioning for classification problems

Pattern Recognition
Engineering multiversion neural-net systems

Neural Computation
Collective-agreement-based pruning of ensembles

Computational Statistics & Data Analysis
Solving multiclass learning problems via error-correcting output codes

Journal of Artificial Intelligence Research
Constructing diverse classifier ensembles using artificial training examples

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Some studies in machine learning using the game of checkers. II: recent progress

IBM Journal of Research and Development
Negative correlation learning and the ambiguity family of ensemble methods

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Selective ensemble of decision trees

RSFDGrC'03 Proceedings of the 9th international conference on Rough sets, fuzzy sets, data mining, and granular computing
Data Mining with Decision Trees: Theroy and Applications

Data Mining with Decision Trees: Theroy and Applications
Bagging, boosting, and C4.S

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Generate different neural networks by negative correlation learning

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
Top-down induction of decision trees classifiers - a survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Neural and statistical classifiers-taxonomy and two case studies

IEEE Transactions on Neural Networks
Structurally adaptive modular networks for nonstationary environments

IEEE Transactions on Neural Networks
A comparison of methods for multiclass support vector machines

IEEE Transactions on Neural Networks
A constructive algorithm for training cooperative neural network ensembles

IEEE Transactions on Neural Networks
New results on error correcting output codes of kernel machines

IEEE Transactions on Neural Networks

The use of artificial intelligence based techniques for intrusion detection: a review

Artificial Intelligence Review
An empirical study of classification algorithm evaluation for financial risk prediction

Applied Soft Computing
Hybrid artificial neural networks: models, algorithms and data

IWANN'11 Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part II
Adaptive ROC-based ensembles of HMMs applied to anomaly detection

Pattern Recognition
Classification by cluster analysis: a new meta-learning based approach

MCS'11 Proceedings of the 10th international conference on Multiple classifier systems
Improvements in image categorization using codebook ensembles

Image and Vision Computing
An incremental ensemble of classifiers

Artificial Intelligence Review
Collaborative ranking: a case study on entity linking

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Application of mixture of experts to construct real estate appraisal models

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part I
User preferences based software defect detection algorithms selection using MCDM

Information Sciences: an International Journal
Selective voting in convex-hull ensembles improves classification accuracy

Artificial Intelligence in Medicine
Handling concept drift via ensemble and class distribution estimation technique

ADMA'11 Proceedings of the 7th international conference on Advanced Data Mining and Applications - Volume Part II
Bagging ensemble selection

AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
LoGID: An adaptive framework combining local and global incremental learning for dynamic selection of ensembles of HMMs

Pattern Recognition
Mal-ID: automatic malware detection using common segment analysis and meta-features

The Journal of Machine Learning Research
Bisociative literature mining by ensemble heuristics

Bisociative Knowledge Discovery
Wind turbines fault diagnosis using ensemble classifiers

ICDM'12 Proceedings of the 12th Industrial conference on Advances in Data Mining: applications and theoretical aspects
Predicting warfarin dosage from clinical data: A supervised learning approach

Artificial Intelligence in Medicine
Combining features of negative correlation learning with mixture of experts in proposed ensemble methods

Applied Soft Computing
Credit risk assessment and decision making by a fusion approach

Knowledge-Based Systems
Ensemble approaches for regression: A survey

ACM Computing Surveys (CSUR)
Automatic discovery of the root causes for quality drift in high dimensionality manufacturing processes

Journal of Intelligent Manufacturing
Anomaly based intrusion detection using meta ensemble classifier

Proceedings of the Fifth International Conference on Security of Information and Networks
The CASH algorithm-cost-sensitive attribute selection using histograms

Information Sciences: an International Journal
Diagnose the premalignant pancreatic cancer using high dimensional linear machine

PRIB'12 Proceedings of the 7th IAPR international conference on Pattern Recognition in Bioinformatics
Bagging and Boosting statistical machine translation systems

Artificial Intelligence
Bagging ensemble selection for regression

AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Multimodal recognition of visual concepts using histograms of textual concepts and selective weighted late fusion scheme

Computer Vision and Image Understanding
On the combination of relative clustering validity criteria

Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Subpopulation-specific confidence designation for more informative biomedical classification

Artificial Intelligence in Medicine
Dynamic classifier selection for One-vs-One strategy: Avoiding non-competent classifiers

Pattern Recognition
EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling

Pattern Recognition
Nonnegative Least-Squares Methods for the Classification of High-Dimensional Biological Data

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Approaches to adversarial drift

Proceedings of the 2013 ACM workshop on Artificial intelligence and security
Pose invariant face recognition using biological inspired features based on ensemble of classifiers

Journal of Visual Communication and Image Representation
Forecasting with twitter data

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Section on Intelligent Mobile Knowledge Discovery and Management Systems and Special Issue on Social Web Mining
Disulfide connectivity prediction based on structural information without a prior knowledge of the bonding state of cysteines

Computers in Biology and Medicine
Learning ensemble classifiers via restricted Boltzmann machines

Pattern Recognition Letters
An Embedded Co-AdaBoost based construction of software document relation coupled resource spaces for cyber-physical society

Future Generation Computer Systems
A framework for selection and fusion of pattern classifiers in multimedia recognition

Pattern Recognition Letters
Ensembles for unsupervised outlier detection: challenges and research questions a position paper

ACM SIGKDD Explorations Newsletter
Integrating global and local application of random subspace ensemble

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

The idea of ensemble methodology is to build a predictive model by integrating multiple models. It is well-known that ensemble methods can be used for improving prediction performance. Researchers from various disciplines such as statistics and AI considered the use of ensemble methodology. This paper, review existing ensemble techniques and can be served as a tutorial for practitioners who are interested in building ensemble based systems.