A new fuzzy decision tree classification method for mining high-speed data streams based on binary search trees

  • Authors:
  • Zhoujun Li;Tao Wang;Ruoxue Wang;Yuejin Yan;Huowang Chen

  • Affiliations:
  • School of Computer Science & Engineering, Beihang University, Beijing, China;Computer School, National University of Defense Technology, Changsha, China;Journal of Computer Research and Development, Beijing, China;Computer School, National University of Defense Technology, Changsha, China;Computer School, National University of Defense Technology, Changsha, China

  • Venue:
  • FAW'07 Proceedings of the 1st annual international conference on Frontiers in algorithmics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Decision tree construction is a well-studied problem in data mining. Recently, there has been much interest in mining data streams. Domingos and Hulten have presented a one-pass algorithm for decision tree constructions. Their system using Hoeffding inequality to achieve a probabilistic bound on the accuracy of the tree constructed. Gama et al. have extended VFDT in two directions. Their system VFDTc can deal with continuous data and use more powerful classification techniques at tree leaves. Peng et al. present soft discretization method to solve continuous attributes in data mining. In this paper, we revisit these problems and implemented a system sVFDT for data stream mining. We make the following contributions: 1) we present a binary search trees (BST) approach for efficiently handling continuous attributes. Its processing time for values inserting is O(nlogn), while VFDT's processing time is O(n2). 2) We improve the method of getting the best split-test point of a given continuous attribute. Comparing to the method used in VFDTc, it decreases from O(nlogn) to O (n) in processing time. 3) Comparing to VFDTc, sVFDT's candidate split-test number decrease from O(n) to O(logn).4)Improve the soft discretization method to increase classification accuracy in data stream mining.