A generative dyadic aspect model for evidence accumulation clustering

  • Authors:
  • André Lourenço;Ana Fred;Mário Figueiredo

  • Affiliations:
  • Instituto de Telecomunicações and Instituto Superior Técnico, Lisboa, Portugal and Instituto Superior de Engenharia de Lisboa;Instituto de Telecomunicações and Instituto Superior Técnico, Lisboa, Portugal;Instituto de Telecomunicações and Instituto Superior Técnico, Lisboa, Portugal

  • Venue:
  • SIMBAD'11 Proceedings of the First international conference on Similarity-based pattern recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Evidence accumulation clustering (EAC) is a clustering combination method in which a pair-wise similarity matrix (the so-called co-association matrix) is learnt from a clustering ensemble. This coassociation matrix counts the co-occurrences (in the same cluster) of pairs of objects, thus avoiding the cluster correspondence problem faced by many other clustering combination approaches. Starting from the observation that co-occurrences are a special type of dyads, we propose to model co-association using a generative aspect model for dyadic data. Under the proposed model, the extraction of a consensus clustering corresponds to solving a maximum likelihood estimation problem, which we address using the expectation-maximization algorithm. We refer to the resulting method as probabilistic ensemble clustering algorithm (PEnCA). Moreover, the fact that the problem is placed in a probabilistic framework allows using model selection criteria to automatically choose the number of clusters. To compare our method with other combination techniques (also based on probabilistic modeling of the clustering ensemble problem), we performed experiments with synthetic and real benchmark data-sets, showing that the proposed approach leads to competitive results.