Information theoretic pairwise clustering

  • Authors:
  • Avishay Friedman;Jacob Goldberger

  • Affiliations:
  • Engineering Faculty, Bar-Ilan University, Ramat-Gan, Israel;Engineering Faculty, Bar-Ilan University, Ramat-Gan, Israel

  • Venue:
  • SIMBAD'13 Proceedings of the Second international conference on Similarity-Based Pattern Recognition
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we develop an information-theoretic approach for pairwise clustering. The Laplacian of the pairwise similarity matrix can be used to define a Markov random walk on the data points. This view forms a probabilistic interpretation of spectral clustering methods. We utilize this probabilistic model to define a novel clustering cost function that is based on maximizing the mutual information between consecutively visited clusters of states of the Markov chain defined by the graph Laplacian matrix. The algorithm complexity is linear on sparse graphs. The improved performance and the reduced computational complexity of the proposed algorithm are demonstrated on several standard datasets.