On determining the optimal partition in agglomerative clustering of documents

  • Authors:
  • Ahmad El Sayed;Hakim Hacid;Djamel Zighed

  • Affiliations:
  • ERIC Laboratory, University of Lyon, Bron cedex, France;ERIC Laboratory, University of Lyon, Bron cedex, France;ERIC Laboratory, University of Lyon, Bron cedex, France

  • Venue:
  • ISMIS'08 Proceedings of the 17th international conference on Foundations of intelligent systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The goal of any clustering algorithm producing flat partitions of data, is to find both the optimal clustering solution and the optimal number of clusters. One natural way to reach this goal without the need for parameters, is to involve a validity index in a clustering process, which can lead to an objective selection of the optimal number of clusters. In this paper, we provide an evaluation of the major relative indices involving them in an agglomerative clustering algorithm for documents. The evaluation seeks the indices ability to identify both the optimal solution and the optimal number of clusters. Then, we propose a new context-aware method that aims at enhancing the validity indices usage as stopping criteria in agglomerative algorithms. Experimental results show that the method is a step-forward in using, with more reliability, validity indices as stopping criteria.