Locally weighted naive bayes

Authors:
Eibe Frank;Mark Hall;Bernhard Pfahringer
Affiliations:
Department of Computer Science, University of Waikato, Hamilton, New Zealand;Department of Computer Science, University of Waikato, Hamilton, New Zealand;Department of Computer Science, University of Waikato, Hamilton, New Zealand
Venue:
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Year:
2002

Citing 7
Cited 49

Locally Weighted Learning

Artificial Intelligence Review - Special issue on lazy learning
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss

Machine Learning - Special issue on learning with probabilistic representations
Bayesian Network Classifiers

Machine Learning - Special issue on learning with probabilistic representations
Lazy Learning of Bayesian Rules

Machine Learning
The CN2 Induction Algorithm

Machine Learning
Semi-Naive Bayesian Classifier

EWSL '91 Proceedings of the European Working Session on Machine Learning
Induction of Recursive Bayesian Classifiers

ECML '93 Proceedings of the European Conference on Machine Learning

Developing practical automatic metadata assignment and evaluation tools for internet resources

Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries
Learning Instance Greedily Cloning Naive Bayes for Ranking

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
Local bagging of decision stumps

IEA/AIE'2005 Proceedings of the 18th international conference on Innovations in Applied Artificial Intelligence
Local averaging of heterogeneous regression models

International Journal of Hybrid Intelligent Systems
Trajectory based word sense disambiguation

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Local voting of weak classifiers

International Journal of Knowledge-based and Intelligent Engineering Systems
Probability Based Metrics for Locally Weighted Naive Bayes

CAI '07 Proceedings of the 20th conference of the Canadian Society for Computational Studies of Intelligence on Advances in Artificial Intelligence
Survey of Improving Naive Bayes for Classification

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Searching for Interacting Features for Spam Filtering

ISNN '08 Proceedings of the 5th international symposium on Neural Networks: Advances in Neural Networks
Local reweight wrapper for the problem of imbalance

International Journal of Artificial Intelligence and Soft Computing
Analysis of Naive Bayes' assumptions on software fault data: An empirical study

Data & Knowledge Engineering
Educational data mining: a case study for predicting dropout-prone students

International Journal of Knowledge Engineering and Soft Data Paradigms
Locally application of cascade generalization for classification problems

Intelligent Decision Technologies
On the value of combining feature subset selection with genetic algorithms: faster learning of coverage models

PROMISE '09 Proceedings of the 5th International Conference on Predictor Models in Software Engineering
How to build repeatable experiments

PROMISE '09 Proceedings of the 5th International Conference on Predictor Models in Software Engineering
Learning decision tree for ranking

Knowledge and Information Systems
Handling Multimodal Information Fusion with Missing Observations Using the Neutral Point Substitution Method

MCS '09 Proceedings of the 8th International Workshop on Multiple Classifier Systems
Lazy naive credal classifier

Proceedings of the 1st ACM SIGKDD Workshop on Knowledge Discovery from Uncertain Data
Overview of advanced computer vision systems for skin lesions characterization

IEEE Transactions on Information Technology in Biomedicine - Special section on computational intelligence in medical systems
An Empirical Study on Several Classification Algorithms and Their Improvements

ISICA '09 Proceedings of the 4th International Symposium on Advances in Computation and Intelligence
Using locally weighted learning to improve SMOreg for regression

PRICAI'06 Proceedings of the 9th Pacific Rim international conference on Artificial intelligence
Learning locally weighted C4.4 for class probability estimation

DS'07 Proceedings of the 10th international conference on Discovery science
Nearest neighbour group-based classification

Pattern Recognition
Machine learning of clinical performance in a pancreatic cancer database

Artificial Intelligence in Medicine
Local rotation-based ensemble

International Journal of Knowledge Engineering and Data Mining
Identification of fraudulent financial statements using linguistic credibility analysis

Decision Support Systems
Data classification using rough sets and naïve Bayes

RSKT'10 Proceedings of the 5th international conference on Rough set and knowledge technology
Collaborative user modeling with user-generated tags for social recommender systems

Expert Systems with Applications: An International Journal
One Dependence Value Difference Metric

Knowledge-Based Systems
Transfer learning for cross-company software defect prediction

Information and Software Technology
Dynamic k-nearest-neighbor naive bayes with attribute weighted

FSKD'06 Proceedings of the Third international conference on Fuzzy Systems and Knowledge Discovery
Local additive regression of decision stumps

SETN'06 Proceedings of the 4th Helenic conference on Advances in Artificial Intelligence
Comparative analysis of learning and meta-learning algorithms for creating models for predicting the probable alcohol level during the ripening of grape berries

Computers and Electronics in Agriculture
Learning Instance Weighted Naive Bayes from labeled and unlabeled data

Journal of Intelligent Information Systems
Learning k-nearest neighbor naive bayes for ranking

ADMA'05 Proceedings of the First international conference on Advanced Data Mining and Applications
Multinomial naive bayes for text categorization revisited

AI'04 Proceedings of the 17th Australian joint conference on Advances in Artificial Intelligence
Instance cloning local naive bayes

AI'05 Proceedings of the 18th Canadian Society conference on Advances in Artificial Intelligence
Enhancing SNNB with local accuracy estimation and ensemble techniques

DASFAA'05 Proceedings of the 10th international conference on Database Systems for Advanced Applications
Lazy averaged one-dependence estimators

AI'06 Proceedings of the 19th international conference on Advances in Artificial Intelligence: Canadian Society for Computational Studies of Intelligence
Local vs. global models for effort estimation and defect prediction

ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
A Modified Short and Fukunaga Metric based on the attribute independence assumption

Pattern Recognition Letters
A network intrusion detection system based on a Hidden Naïve Bayes multiclass classifier

Expert Systems with Applications: An International Journal
Automated feature weighting in naive bayes for high-dimensional data classification

Proceedings of the 21st ACM international conference on Information and knowledge management
Gene selection for cancer tumor detection using a novel memetic algorithm with a multi-view fitness function

Engineering Applications of Artificial Intelligence
A comparison of machine learning algorithms for proactive hard disk drive failure detection

Proceedings of the 4th international ACM Sigsoft symposium on Architecting critical systems
An Augmented Value Difference Measure

Pattern Recognition Letters
On the relationship between head pose, social attention and personality prediction for unstructured and dynamic group interactions

Proceedings of the 15th ACM on International conference on multimodal interaction
A hybrid decision tree classifier

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
Integrating global and local application of random subspace ensemble

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Despite its simplicity, the naive Bayes classifier has surprised machine learning researchers by exhibiting good performance on a variety of learning problems. Encouraged by these results, researchers have looked to overcome naive Bayes' primary weakness-attribute independence-and improve the performance of the algorithm. This paper presents a locally weighted version of naive Bayes that relaxes the independence assumption by learning local models at prediction time. Experimental results show that locally weighted naive Bayes rarely degrades accuracy compared to standard naive Bayes and, in many cases, improves accuracy dramatically. The main advantage of this method compared to other techniques for enhancing naive Bayes is its conceptual and computational simplicity.