Locally adaptive metrics for clustering high dimensional data

  • Authors:
  • Carlotta Domeniconi;Dimitrios Gunopulos;Sheng Ma;Bojun Yan;Muna Al-Razgan;Dimitris Papadopoulos

  • Affiliations:
  • George Mason University, Fairfax, USA;UC Riverside, Riverside, USA;Vivido Media Inc., Beijing, China 100085;George Mason University, Fairfax, USA;George Mason University, Fairfax, USA;UC Riverside, Riverside, USA

  • Venue:
  • Data Mining and Knowledge Discovery
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Clustering suffers from the curse of dimensionality, and similarity functions that use all input features with equal relevance may not be effective. We introduce an algorithm that discovers clusters in subspaces spanned by different combinations of dimensions via local weightings of features. This approach avoids the risk of loss of information encountered in global dimensionality reduction techniques, and does not assume any data distribution model. Our method associates to each cluster a weight vector, whose values capture the relevance of features within the corresponding cluster. We experimentally demonstrate the gain in perfomance our method achieves with respect to competitive methods, using both synthetic and real datasets. In particular, our results show the feasibility of the proposed technique to perform simultaneous clustering of genes and conditions in gene expression data, and clustering of very high-dimensional data such as text data.