Languages as hyperplanes: grammatical inference with string kernels

  • Authors:
  • Alexander Clark;Christophe Costa Florêncio;Chris Watkins

  • Affiliations:
  • Department of Computer Science, Royal Holloway, University of London, Egham, UK TW20 0EX;Department of Computer Science, K.U. Leuven, Heverlee (Leuven), Belgium 3001;Department of Computer Science, Royal Holloway, University of London, Egham, UK TW20 0EX

  • Venue:
  • Machine Learning
  • Year:
  • 2011

Quantified Score

Hi-index 0.02

Visualization

Abstract

Using string kernels, languages can be represented as hyperplanes in a high dimensional feature space. We discuss the language-theoretic properties of this formalism with particular reference to the implicit feature maps defined by string kernels, considering the expressive power of the formalism, its closure properties and its relationship to other formalisms. We present a new family of grammatical inference algorithms based on this idea. We demonstrate that some mildly context-sensitive languages can be represented in this way and that it is possible to efficiently learn these using kernel PCA. We experimentally demonstrate the effectiveness of this approach on some standard examples of context-sensitive languages using small synthetic data sets.