Document clustering based on maximal frequent sequences

  • Authors:
  • Edith Hernández-Reyes;Rene A. García-Hernández;J. A. Carrasco-Ochoa;J. Fco. Martínez-Trinidad

  • Affiliations:
  • Optics and Electronics, National Institute for Astrophysics, Tonantzintla, Puebla, México;Optics and Electronics, National Institute for Astrophysics, Tonantzintla, Puebla, México;Optics and Electronics, National Institute for Astrophysics, Tonantzintla, Puebla, México;Optics and Electronics, National Institute for Astrophysics, Tonantzintla, Puebla, México

  • Venue:
  • FinTAL'06 Proceedings of the 5th international conference on Advances in Natural Language Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Document clustering has the goal of discovering groups with similar documents. The success of the document clustering algorithms depends on the model used for representing these documents. Documents are commonly represented with the vector space model based on words or n-grams. However, these representations have some disadvantages such as high dimensionality and loss of the word sequential order. In this work, we propose a new document representation in which the maximal frequent sequences of words are used as features of the vector space model. The proposed model efficiency is evaluated by clustering different document collections and compared against the vector space model based on words and n-grams, through internal and external measures.