A phase transition-based perspective on multiple instance kernels

  • Authors:
  • Romaric Gaudel;Michèle Sebag;Antoine Cornuéjols

  • Affiliations:
  • CNRS, INRIA, Univ. Paris-Sud, Orsay, France and École Normale Supérieure de Cachan;CNRS, INRIA, Univ. Paris-Sud, Orsay, France;AgroParisTech, INRA, Paris, France

  • Venue:
  • ILP'07 Proceedings of the 17th international conference on Inductive logic programming
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper is concerned with Relational Support Vector Machines, at the intersection of Support Vector Machines (SVM) and Inductive Logic Programming or Relational Learning. The so-called phase transition framework, originally developed for constraint satisfaction problems, has been extended to relational learning and it has provided relevant insights into the limitations and difficulties thereof. The goal of this paper is to examine relational SVMs and specifically Multiple Instance (MI) Kernels along the phase transition framework. A relaxation of the MI-SVM problem formalized as a linear programming problem (LPP) is defined and we show that the LPP satisfiability rate induces a lower bound on the MI-SVM generalization error. An extensive experimental study shows the existence of a critical region, where both LPP unsatisfiability and MI-SVM error rates are high. An interpretation for these results is proposed.