Constructing diverse classifier ensembles using artificial training examples

Authors:
Prem Melville;Raymond J. Mooney
Affiliations:
Department of Computer Sciences, University of Texas, Austin, TX;Department of Computer Sciences, University of Texas, Austin, TX
Venue:
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Year:
2003

Citing 8
Cited 63

C4.5: programs for machine learning

C4.5: programs for machine learning
Improving Generalization with Active Learning

Machine Learning - Special issue on structured connectionist systems
Bagging predictors

Machine Learning
Data mining: practical machine learning tools and techniques with Java implementations

Data mining: practical machine learning tools and techniques with Java implementations
Ensemble learning via negative correlation

Neural Networks
Text Classification from Labeled and Unlabeled Documents using EM

Machine Learning - Special issue on information retrieval
MultiBoosting: A Technique for Combining Boosting and Wagging

Machine Learning
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants

Machine Learning

Diverse ensembles for active learning

ICML '04 Proceedings of the twenty-first international conference on Machine learning
An evidential approach in ensembles

Proceedings of the 2006 ACM symposium on Applied computing
Model compression

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Local voting of weak classifiers

International Journal of Knowledge-based and Intelligent Engineering Systems
Ensembling evidential k-nearest neighbor classifiers through multi-modal perturbation

Applied Soft Computing
Decision trees using model ensemble-based nodes

Pattern Recognition
The Dynamics of Negative Correlation Learning

Journal of VLSI Signal Processing Systems
Machine learning: a review of classification and combining techniques

Artificial Intelligence Review
Multiclass classification using neural networks and interval neutrosophic sets

CIMMACS'06 Proceedings of the 5th WSEAS International Conference on Computational Intelligence, Man-Machine Systems and Cybernetics
The combination of multiple classifiers using an evidential reasoning approach

Artificial Intelligence
Dual Strategy Active Learning

ECML '07 Proceedings of the 18th European conference on Machine Learning
Combining Classifiers through Triplet-Based Belief Functions

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
CONSENSUS-BASED ENSEMBLES OF SOFT CLUSTERINGS

Applied Artificial Intelligence
Handling imbalanced data sets with a modification of Decorate algorithm

International Journal of Computer Applications in Technology
An Empirical Study of Combined Classifiers for Knowledge Discovery on Medical Data Bases

Advanced Web and NetworkTechnologies, and Applications
Combining Bagging, Boosting and Dagging for Classification Problems

KES '07 Knowledge-Based Intelligent Information and Engineering Systems and the XVII Italian Workshop on Neural Networks on Proceedings of the 11th International Conference
Accuracy of machine learning models versus "hand crafted" expert systems - A credit scoring case study

Expert Systems with Applications: An International Journal
Locally application of cascade generalization for classification problems

Intelligent Decision Technologies
Porosity Prediction Using Bagging of Complementary Neural Networks

ISNN '09 Proceedings of the 6th International Symposium on Neural Networks on Advances in Neural Networks
Supervised Machine Learning: A Review of Classification Techniques

Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies
Classifier Combination Using a Class-indifferent Method

Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Binary classification using ensemble neural networks and interval neutrosophic sets

Neurocomputing
Rough Ensemble Classifier: A Comparative Study

WILF '09 Proceedings of the 8th International Workshop on Fuzzy Logic and Applications
An ensemble technique for stable learners with performance bounds

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Computational Statistics & Data Analysis
Spectrum of variable-random trees

Journal of Artificial Intelligence Research
Artificial intelligence in genomic sequence, protein structure function prediction and DNA microarrays: a survey

International Journal of Computational Intelligence in Bioinformatics and Systems Biology
Banknote and coin speaker device for blind people

ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3
Ensemble-based classifiers

Artificial Intelligence Review
Semi-supervised learning approaches for predicting semantic characteristics of lung nodules

Intelligent Decision Technologies - Special issue on advances in medical intelligent decision support systems
An investigation into the relationship between semantic and content based similarity using LIDC

Proceedings of the international conference on Multimedia information retrieval
Active learning with misclassification sampling using diverse ensembles enhanced by unlabeled instances

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
On exploration of classifier ensemble synergism in pedestrian detection

IEEE Transactions on Intelligent Transportation Systems
A dynamic classifier ensemble selection approach for noise data

Information Sciences: an International Journal
Local rotation-based ensemble

International Journal of Knowledge Engineering and Data Mining
A new encoding technique for peptide classification

Expert Systems with Applications: An International Journal
Soft spectral clustering ensemble applied to image segmentation

Frontiers of Computer Science in China
Combining bagging, boosting, rotation forest and random subspace methods

Artificial Intelligence Review
Multi-agent based classification using argumentation from experience

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
Remote sensing image classification based on neural network ensemble algorithm

Neurocomputing
Improvements in image categorization using codebook ensembles

Image and Vision Computing
Wisdom of artificial crowds algorithm for solving NP-hard problems

International Journal of Bio-Inspired Computation
Two-Stage classifier for diagnosis of hypertension type

ISBMDA'06 Proceedings of the 7th international conference on Biological and Medical Data Analysis
Multi-class ensemble-based active learning

ECML'06 Proceedings of the 17th European conference on Machine Learning
Bagging model trees for classification problems

PCI'05 Proceedings of the 10th Panhellenic conference on Advances in Informatics
Improving classification for microarray data sets by constructing synthetic data

CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
Active learning for probability estimation using jensen-shannon divergence

ECML'05 Proceedings of the 16th European conference on Machine Learning
Network game and boosting

ECML'05 Proceedings of the 16th European conference on Machine Learning
Bagging random trees for estimation of tissue softness

MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
Boosting-based ensemble learning with penalty profiles for automatic Thai unknown word recognition

Computers & Mathematics with Applications
Improving bagging performance through multi-algorithm ensembles

PAKDD'11 Proceedings of the 15th international conference on New Frontiers in Applied Data Mining
A Robust Multi-Class Feature Selection Strategy Based on Rotation Forest Ensemble Algorithm for Diagnosis of Erythemato-Squamous Diseases

Journal of Medical Systems
PISA: A framework for multiagent classification using argumentation

Data & Knowledge Engineering
Biclustering-driven ensemble of Bayesian belief network classifiers for underdetermined problems

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Multi-agent based classification using argumentation from experience

Autonomous Agents and Multi-Agent Systems
Forecasting fraudulent financial statements with committee of cost-sensitive decision tree classifiers

SETN'12 Proceedings of the 7th Hellenic conference on Artificial Intelligence: theories and applications
A heuristically perturbation of dataset to achieve a diverse ensemble of classifiers

MCPR'12 Proceedings of the 4th Mexican conference on Pattern Recognition
A heuristic diversity production approach

ICCSA'12 Proceedings of the 12th international conference on Computational Science and Its Applications - Volume Part III
Exploiting unlabeled data to enhance ensemble diversity

Data Mining and Knowledge Discovery
Gene selection for cancer tumor detection using a novel memetic algorithm with a multi-view fitness function

Engineering Applications of Artificial Intelligence
A diversity production approach in ensemble of base classifiers

MICAI'12 Proceedings of the 11th Mexican international conference on Advances in Artificial Intelligence - Volume Part I
An investigation into the application of ensemble learning for entailment classification

Information Processing and Management: an International Journal
Integrating global and local application of random subspace ensemble

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Ensemble methods like bagging and boosting that combine the decisions of multiple hypotheses are some of the strongest existing machine learning methods. The diversity of the members of an ensemble is known to be an important factor in determining its generalization error. This paper presents a new method for generating ensembles that directly constructs diverse hypotheses using additional artificially-constructed training examples. The technique is a simple, general metalearner that can use any strong learner as a base classifier to build diverse committees. Experimental results using decision-tree induction as a base learner demonstrate that this approach consistently achieves higher predictive accuracy than both the base classifier and bagging (whereas boosting can occasionally decrease accuracy), and also obtains higher accuracy than boosting early in the learning curve when training data is limited.