Naïve Bayes ensemble learning based on oracle selection

Authors:
Kai Li;Lifeng Hao
Affiliations:
School of Mathematics and Computer, Hebei University, Baoding, China and Key Lab. In Machine Learning and Computational Intelligence of Hebei Province, Baoding, China;School of Mathematics and Computer, Hebei University, Baoding, China and Key Lab. In Machine Learning and Computational Intelligence of Hebei Province, Baoding, China
Venue:
CCDC'09 Proceedings of the 21st annual international conference on Chinese Control and Decision Conference
Year:
2009

Citing 5
Cited 0

An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants

Machine Learning
Neural Network Ensembles

IEEE Transactions on Pattern Analysis and Machine Intelligence
Classifier Ensembles with a Random Linear Oracle

IEEE Transactions on Knowledge and Data Engineering
Ensembles as a sequence of classifiers

IJCAI'97 Proceedings of the Fifteenth international joint conference on Artifical intelligence - Volume 2
Naïve Bayes ensembles with a random oracle

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Aiming at the stability of Naïve Bayes algorithm and overcoming the limitation of the attributes independence assumption in the Naive Bayes learning, we present an ensemble learning algorithm for naive Bayesian classifiers based on oracle selection (OSBE). Firstly we weaken the stability of the naive Bayes with oracle strategy, then select the better classifier as the component of ensemble of the naive Bayesian classifiers, finally integrate the classifiers' results with voting method. The experiments show that OSBE ensemble algorithm obviously improves the generalization performance which is compared with the Naïve Bayes learning. And it prove in some cases the OSBE algorithm have better classification accuracy than Bagging and Adaboost.