On Pairwise Naive Bayes Classifiers

  • Authors:
  • Jan-Nikolas Sulzmann;Johannes Fürnkranz;Eyke Hüllermeier

  • Affiliations:
  • Department of Computer Science, TU Darmstadt, Hochschulstr. 10, D-64289 Darmstadt, Germany;Department of Computer Science, TU Darmstadt, Hochschulstr. 10, D-64289 Darmstadt, Germany;Informatics Institute, Marburg University, Hans-Meerwein-Str., Lahnberge, D-35032 Marburg, Germany

  • Venue:
  • ECML '07 Proceedings of the 18th European conference on Machine Learning
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Class binarizations are effective methods for improving weak learners by decomposing multi-class problems into several two-class problems. This paper analyzes how these methods can be applied to a Naive Bayes learner. The key result is that the pairwise variant of Naive Bayes is equivalent to a regular Naive Bayes. This result holds for several aggregation techniques for combining the predictions of the individual classifiers, including the commonly used voting and weighted voting techniques. On the other hand, Naive Bayes with one-against-all binarization is not equivalent to a regular Naive Bayes. Apart from the theoretical results themselves, the paper offers a discussion of their implications.