An incremental data stream clustering algorithm based on dense units detection

  • Authors:
  • Jing Gao;Jianzhong Li;Zhaogong Zhang;Pang-Ning Tan

  • Affiliations:
  • Dept. of Computer Science & Engineering, Michigan State University, East Lansing, MI;Dept. of Computer Science & Technology, Harbin Institute of Technology, Harbin, China;Dept. of Computer Science & Technology, Harbin Institute of Technology, Harbin, China;Dept. of Computer Science & Engineering, Michigan State University, East Lansing, MI

  • Venue:
  • PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The data stream model of computation is often used for analyzing huge volumes of continuously arriving data. In this paper, we present a novel algorithm called DUCstream for clustering data streams. Our work is motivated by the needs to develop a single-pass algorithm that is capable of detecting evolving clusters, and yet requires little memory and computation time. To that end, we propose an incremental clustering method based on dense units detection. Evolving clusters are identified on the basis of the dense units, which contain relatively large number of points. For efficiency reasons, a bitwise dense unit representation is introduced. Our experimental results demonstrate DUCstream's efficiency and efficacy.