Online knowledge-based support vector machines

  • Authors:
  • Gautam Kunapuli;Kristin P. Bennett;Amina Shabbeer;Richard Maclin;Jude Shavlik

  • Affiliations:
  • University of Wisconsin-Madison;Rensselaer Polytechnic Insitute;Rensselaer Polytechnic Insitute;University of Minnesota, Duluth;University of Wisconsin-Madison

  • Venue:
  • ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part II
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Prior knowledge, in the form of simple advice rules, can greatly speed up convergence in learning algorithms. Online learning methods predict the label of the current point and then receive the correct label (and learn from that information). The goal of this work is to update the hypothesis taking into account not just the label feedback, but also the prior knowledge, in the form of soft polyhedral advice, so as to make increasingly accurate predictions on subsequent examples. Advice helps speed up and bias learning so that generalization can be obtained with less data. Our passive-aggressive approach updates the hypothesis using a hybrid loss that takes into account the margins of both the hypothesis and the advice on the current point. Encouraging computational results and loss bounds are provided.