Learning bounds for support vector machines with learned kernels

  • Authors:
  • Nathan Srebro;Shai Ben-David

  • Affiliations:
  • Department of Computer Science, University of Toronto, Toronto, ON, Canada;School of Computer Science, University of Waterloo, Waterloo, ON, Canada

  • Venue:
  • COLT'06 Proceedings of the 19th annual conference on Learning Theory
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Consider the problem of learning a kernel for use in SVM classification. We bound the estimation error of a large margin classifier when the kernel, relative to which this margin is defined, is chosen from a family of kernels based on the training sample. For a kernel family with pseudodimensiondφ, we present a bound of $\sqrt{\tilde{\mathcal{O}}{({d_{\phi}}+1/\gamma^2)}/n}$on the estimation error for SVMs with margin γ. This is the first bound in which the relation between the margin term and the family-of-kernels term is additive rather then multiplicative. The pseudodimension of families of linear combinations of base kernels is the number of base kernels. Unlike in previous (multiplicative) bounds, there is no non-negativity requirement on the coefficients of the linear combinations. We also give simple bounds on the pseudodimension for families of Gaussian kernels.