Similarity word-sequence kernels for sentence clustering

  • Authors:
  • Jesús Andrés-Ferrer;Germán Sanchis-Trilles;Francisco Casacuberta

  • Affiliations:
  • Instituto Tecnológico de Informática, Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia;Instituto Tecnológico de Informática, Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia;Instituto Tecnológico de Informática, Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia

  • Venue:
  • SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a novel clustering approach based on the use of kernels as similarity functions and the C-means algorithm. Several word-sequence kernels are defined and extended to verify the properties of similarity functions. Afterwards, these monolingual wordsequence kernels are extended to bilingual word-sequence kernels, and applied to the task of monolingual and bilingual sentence clustering. The motivation of this proposal is to group similar sentences into clusters so that specialised models can be trained for each cluster, with the purpose of reducing in this way both the size and complexity of the initial task.We provide empirical evidence for proving that the use of bilingual kernels can lead to better clusters, in terms of intra-cluster perplexities.