Not So Naive Bayes: Aggregating One-Dependence Estimators

Authors:
Geoffrey I. Webb;Janice R. Boughton;Zhihai Wang
Affiliations:
School of Computer Science and Software Engineering, Monash University, Australia 3800;School of Computer Science and Software Engineering, Monash University, Australia 3800;School of Computer Science and Software Engineering, Monash University, Australia 3800
Venue:
Machine Learning
Year:
2005

Citing 0
Cited 98

Efficient discriminative learning of Bayesian network classifier via boosted augmented naive Bayes

ICML '05 Proceedings of the 22nd international conference on Machine learning
Augmenting naive Bayes for ranking

ICML '05 Proceedings of the 22nd international conference on Machine learning
Full Bayesian network classifiers

ICML '06 Proceedings of the 23rd international conference on Machine learning
Efficient lazy elimination for averaged one-dependence estimators

ICML '06 Proceedings of the 23rd international conference on Machine learning
Data Mining Static Code Attributes to Learn Defect Predictors

IEEE Transactions on Software Engineering
Diagnosing scrapie in sheep: A classification experiment

Computers in Biology and Medicine
Effects of highly agreed documents in relevancy prediction

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Classifying under computational resource constraints: anytime classification using probabilistic estimators

Machine Learning
Using classifier ensembles to label spatially disjoint data

Information Fusion
Learning iteratively a classifier with the Bayesian Model Averaging Principle

Pattern Recognition
To Select or To Weigh: A Comparative Study of Linear Combination Schemes for SuperParent-One-Dependence Estimators

IEEE Transactions on Knowledge and Data Engineering
Implications of ceiling effects in defect predictors

Proceedings of the 4th international workshop on Predictor models in software engineering
Classifying under computational resource constraints: anytime classification using probabilistic estimators

Machine Learning
Discriminatively Learning Selective Averaged One-Dependence Estimators Based on Cross-Entropy Method

Computational Intelligence and Security
Survey of Improving Naive Bayes for Classification

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Finding the Right Family: Parent and Child Selection for Averaged One-Dependence Estimators

ECML '07 Proceedings of the 18th European conference on Machine Learning
A Semi-naive Bayes Classifier with Grouping of Cases

ECSQARU '07 Proceedings of the 9th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
Discretization for naive-Bayes learning: managing discretization bias and variance

Machine Learning
Adaptive Bayesian network classifiers

Intelligent Data Analysis
Fitting a graph to vector data

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
GAODE and HAODE: two proposals based on AODE to deal with continuous variables

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Bayesian clustering for email campaign detection

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Latent classification models for binary data

Pattern Recognition
Anytime learning and classification for online applications

Proceedings of the 2006 conference on Advances in Intelligent IT: Active Media Technology 2006
Patch Learning for Incremental Classifier Design

Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy
HODE: Hidden One-Dependence Estimator

ECSQARU '09 Proceedings of the 10th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
A program-based anomaly intrusion detection scheme using multiple detection engines and fuzzy inference

Journal of Network and Computer Applications
Using non-lexical features to identify effective indexing terms for biomedical illustrations

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Anytime classification for a pool of instances

Machine Learning
Instance Selection by Border Sampling in Multi-class Domains

ADMA '09 Proceedings of the 5th International Conference on Advanced Data Mining and Applications
Rule Learning with Probabilistic Smoothing

DaWaK '09 Proceedings of the 11th International Conference on Data Warehousing and Knowledge Discovery
Representing conditional independence using decision trees

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Hidden naive Bayes

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Generalized additive Bayesian network classifiers

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Techniques for evolutionary rule discovery in data mining

CEC'09 Proceedings of the Eleventh conference on Congress on Evolutionary Computation
An Empirical Study on Several Classification Algorithms and Their Improvements

ISICA '09 Proceedings of the 4th International Symposium on Advances in Computation and Intelligence
An Extendable Meta-learning Algorithm for Ontology Mapping

FQAS '09 Proceedings of the 8th International Conference on Flexible Query Answering Systems
Averaged Naive Bayes Trees: A New Extension of AODE

ACML '09 Proceedings of the 1st Asian Conference on Machine Learning: Advances in Machine Learning
Scaling Up the Accuracy of Bayesian Network Classifiers by M-Estimate

ICIC '07 Proceedings of the 3rd International Conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence
Simulated evaluation of faceted browsing based on feature selection

Multimedia Tools and Applications
Weightily averaged one-dependence estimators

PRICAI'06 Proceedings of the 9th Pacific Rim international conference on Artificial intelligence
Evaluating query-independent object features for relevancy prediction

ECIR'07 Proceedings of the 29th European conference on IR research
Apply a rough set-based classifier to dependency parsing

RSKT'08 Proceedings of the 3rd international conference on Rough sets and knowledge technology
An application of document filtering in an operational system

Information Processing and Management: an International Journal
Co-occurrence cluster features for lexical substitutions in context

TextGraphs-5 Proceedings of the 2010 Workshop on Graph-based Methods for Natural Language Processing
Review:

The Knowledge Engineering Review
Random one-dependence estimators

Pattern Recognition Letters
Scaling up the accuracy of Bayesian classifier based on frequent itemsets by m-estimate

AICI'10 Proceedings of the 2010 international conference on Artificial intelligence and computational intelligence: Part I
Data classification using rough sets and naïve Bayes

RSKT'10 Proceedings of the 5th international conference on Rough set and knowledge technology
Detecting and ordering salient regions

Data Mining and Knowledge Discovery
A GRASP algorithm for fast hybrid (filter-wrapper) feature subset selection in high-dimensional datasets

Pattern Recognition Letters
Analyzing the impact of the discretization method when comparing Bayesian classifiers

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
NB+: An improved Naïve Bayesian algorithm

Knowledge-Based Systems
One Dependence Value Difference Metric

Knowledge-Based Systems
Automatic image search based on improved feature descriptors and decision tree

Integrated Computer-Aided Engineering
Handling numeric attributes when comparing Bayesian network classifiers: does the discretization method matter?

Applied Intelligence
Flexible learning of k-dependence Bayesian network classifiers

Proceedings of the 13th annual conference on Genetic and evolutionary computation
Research article: Drug-induced glucose-6-phosphate dehydrogenase deficiency-related hemolysis risk assessment

Computational Biology and Chemistry
Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking

Knowledge-Based Systems
Latent tree classifier

ECSQARU'11 Proceedings of the 11th European conference on Symbolic and quantitative approaches to reasoning with uncertainty
Bayesian classifiers for positive unlabeled learning

WAIM'11 Proceedings of the 12th international conference on Web-age information management
GRAMOFON: General model-selection framework based on networks

Neurocomputing
An incremental ensemble of classifiers

Artificial Intelligence Review
To select or to weigh: a comparative study of model selection and model weighing for SPODE ensembles

ECML'06 Proceedings of the 17th European conference on Machine Learning
Ensemble selection for superparent-one-dependence estimators

AI'05 Proceedings of the 18th Australian Joint conference on Advances in Artificial Intelligence
Improving Tree augmented Naive Bayes for class probability estimation

Knowledge-Based Systems
Robust bayesian linear classifier ensembles

ECML'05 Proceedings of the 16th European conference on Machine Learning
Cascading customized naïve bayes couple

AI'10 Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence
Ensemble learning based on multi-task class labels

PAKDD'10 Proceedings of the 14th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II
Graph-Based model-selection framework for large ensembles

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part I
Bias and variance of rotation-based ensembles

IWANN'05 Proceedings of the 8th international conference on Artificial Neural Networks: computational Intelligence and Bioinspired Systems
Automatic recommendation of classification algorithms based on data set characteristics

Pattern Recognition
Lazy averaged one-dependence estimators

AI'06 Proceedings of the 19th international conference on Advances in Artificial Intelligence: Canadian Society for Computational Studies of Intelligence
Voting massive collections of bayesian network classifiers for data streams

AI'06 Proceedings of the 19th Australian joint conference on Artificial Intelligence: advances in Artificial Intelligence
Double-layer bayesian classifier ensembles based on frequent itemsets

International Journal of Automation and Computing
An unsupervised approach to feature discretization and selection

Pattern Recognition
Non-Disjoint discretization for aggregating one-dependence estimator classifiers

HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part II
Techniques for efficient learning without search

PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part I
A network intrusion detection system based on a Hidden Naïve Bayes multiclass classifier

Expert Systems with Applications: An International Journal
A Bayesian stochastic search method for discovering Markov boundaries

Knowledge-Based Systems
Online speedup learning for optimal planning

Journal of Artificial Intelligence Research
Host load prediction in a Google compute cloud with a Bayesian model

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Classification of photos based on good feelings: ACM MM 2012 multimedia grand challenge submission

Proceedings of the 20th ACM international conference on Multimedia
Automated feature weighting in naive bayes for high-dimensional data classification

Proceedings of the 21st ACM international conference on Information and knowledge management
Creating a system for lexical substitutions from scratch using crowdsourcing

Language Resources and Evaluation
LTC: A latent tree approach to classification

International Journal of Approximate Reasoning
Improving naive Bayes classifier using conditional probabilities

AusDM '11 Proceedings of the Ninth Australasian Data Mining Conference - Volume 121
Active AODE learning based on a novel sampling strategy and its application

International Journal of Computer Applications in Technology
Predicting speech overlaps from speech tokens and co-occurring body behaviours in dyadic conversations

Proceedings of the 15th ACM on International conference on multimodal interaction
Boosting for superparent-one-dependence estimators

International Journal of Computing Science and Mathematics
An ensemble of Bayesian networks for multilabel classification

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
A Bayesian network model for predicting pregnancy after in vitro fertilization

Computers in Biology and Medicine
Credal ensembles of classifiers

Computational Statistics & Data Analysis
Google hostload prediction based on Bayesian model with optimized feature combination

Journal of Parallel and Distributed Computing
Domains of competence of the semi-naive Bayesian network classifiers

Information Sciences: an International Journal
A survey on latent tree models and applications

Journal of Artificial Intelligence Research
Alleviating naive Bayes attribute independence assumption by attribute weighting

The Journal of Machine Learning Research
Learning attribute weighted AODE for ROC area ranking

International Journal of Information and Communication Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Of numerous proposals to improve the accuracy of naive Bayes by weakening its attribute independence assumption, both LBR and Super-Parent TAN have demonstrated remarkable error performance. However, both techniques obtain this outcome at a considerable computational cost. We present a new approach to weakening the attribute independence assumption by averaging all of a constrained class of classifiers. In extensive experiments this technique delivers comparable prediction accuracy to LBR and Super-Parent TAN with substantially improved computational efficiency at test time relative to the former and at training time relative to the latter. The new algorithm is shown to have low variance and is suited to incremental learning.