Text classification with kernels on the multinomial manifold

  • Authors:
  • Dell Zhang;Xi Chen;Wee Sun Lee

  • Affiliations:
  • National University of Singapore, Singapore, Singapore-MIT Alliance, Singapore;University of Alberta, Edmonton, AB, Canada;National University of Singapore, Singapore, Singapore-MIT Alliance, Singapore

  • Venue:
  • Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Support Vector Machines (SVMs) have been very successful in text classification. However, the intrinsic geometric structure of text data has been ignored by standard kernels commonly used in SVMs. It is natural to assume that the documents are on the multinomial manifold, which is the simplex of multinomial models furnished with the Riemannian structure induced by the Fisher information metric. We prove that the Negative Geodesic Distance (NGD) on the multinomial manifold is conditionally positive definite (cpd), thus can be used as a kernel in SVMs. Experiments show the NGD kernel on the multinomial manifold to be effective for text classification, significantly outperforming standard kernels on the ambient Euclidean space.