SCHISM: a new approach to interesting subspace mining

  • Authors:
  • Karlton Sequeira;Mohammed Zaki

  • Affiliations:
  • Department of Computer Science, Rensselaer Polytechnic Institute, 110 8th St, Troy, NY 12180, USA.;Department of Computer Science, Rensselaer Polytechnic Institute, 110 8th St, Troy, NY 12180, USA

  • Venue:
  • International Journal of Business Intelligence and Data Mining
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

High dimensional data pose challenges to traditional clustering algorithms due to their inherent sparseness and data tend to cluster in different and possibly overlapping subspaces of the entire feature space. Finding such subspaces is called subspace mining. We present SCHISM, a new algorithm for mining interesting subspaces, using the notions of support and Chernoff-Hoeffding bounds. We use a vertical representation of the dataset, and use a depth first search with backtracking to find maximal interesting subspaces. We test our algorithm on a number of high dimensional synthetic and real datasets to test its effectiveness.