Orthogonally rotational transformation for naive bayes learning

  • Authors:
  • Limin Wang;Chunhong Cao;Haijun Li;Haixia Chen;Liyan Dong

  • Affiliations:
  • College of Computer Science and Technology, JiLin University, ChangChun, China;College of Information Science and Engineering, Northeastern University, ShenYang, China;College of Computer Science and Technology, JiLin University, ChangChun, China;College of Computer Science and Technology, JiLin University, ChangChun, China;College of Computer Science and Technology, JiLin University, ChangChun, China

  • Venue:
  • CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Naive Bayes is one of the most efficient and effective learning algorithms for machine learning, pattern recognition and data mining. But its conditional independence assumption is rarely true in real-world applications. We show that the independence assumption can be approximated by orthogonally rotational transformation of input space. During the transformation process, the continuous attributes are treated in different ways rather than simply applying discretization or assuming them to satisfy some standard probability distribution. Furthermore, the information from unlabeled instances can be naturally utilized to improve parameter estimation without considering the negative effect caused by missing class labels. The empirical results provide evidences to support our explanation.