Efficient layered density-based clustering of categorical data

  • Authors:
  • Bill Andreopoulos;Aijun An;Xiaogang Wang;Dirk Labudde

  • Affiliations:
  • Biotechnological Centre, Technische Universität Dresden, 47-51 Tatzberg, 01307 Dresden Sachsen, Germany and Dept. of Computer Science and Engineering, York University, Toronto, Canada;Dept. of Computer Science and Engineering, York University, Toronto, Canada;Dept. of Mathematics and Statistics, York University, Toronto, Canada;Biotechnological Centre, Technische Universität Dresden, 47-51 Tatzberg, 01307 Dresden Sachsen, Germany

  • Venue:
  • Journal of Biomedical Informatics
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A challenge involved in applying density-based clustering to categorical biomedical data is that the ''cube'' of attribute values has no ordering defined, making the search for dense subspaces slow. We propose the HIERDENC algorithm for hierarchical density-based clustering of categorical data, and a complementary index for searching for dense subspaces efficiently. The HIERDENC index is updated when new objects are introduced, such that clustering does not need to be repeated on all objects. The updating and cluster retrieval are efficient. Comparisons with several other clustering algorithms showed that on large datasets HIERDENC achieved better runtime scalability on the number of objects, as well as cluster quality. By fast collapsing the bicliques in large networks we achieved an edge reduction of as much as 86.5%. HIERDENC is suitable for large and quickly growing datasets, since it is independent of object ordering, does not require re-clustering when new data emerges, and requires no user-specified input parameters.