A simple and effective method for incorporating advice into kernel methods

Authors:
Richard Maclin;Jude Shavlik;Trevor Walker;Lisa Torrey
Affiliations:
Computer Science Department, University of Minnesota Duluth, Duluth, MN;Computer Sciences Department, University of Wisconsin Madison, Madison, WI;Computer Sciences Department, University of Wisconsin Madison, Madison, WI;Computer Sciences Department, University of Wisconsin Madison, Madison, WI
Venue:
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Year:
2006

Citing 9
Cited 1

Prior knowledge in support vector kernels

NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
Scaling Reinforcement Learning toward RoboCup Soccer

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Incorporating prior knowledge with weighted margin support vector machines

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Knowledge-Based Kernel Approximation

The Journal of Machine Learning Research
Giving advice about preferred actions to reinforcement learners via knowledge-based kernel regression

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Rotational prior knowledge for SVMs

ECML'05 Proceedings of the 16th European conference on Machine Learning
Using advice to transfer knowledge acquired in one reinforcement learning task to another

ECML'05 Proceedings of the 16th European conference on Machine Learning
Support vector inductive logic programming

DS'05 Proceedings of the 8th international conference on Discovery Science

Refining rules incorporated into knowledge-based support vector learners via successive linear programming

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a simple mechanism for incorporating advice (prior knowledge), in the form of simple rules, into support-vector methods for both classification and regression. Our approach is based on introducing inequality constraints associated with datapoints that match the advice. These constrained datapoints can be standard examples in the training set, but can also be unlabeled data in a semi-supervised, advice-taking approach. Our new approach is simpler to implement and more efficiently solved than the knowledge-based support vector classification methods of Fung, Mangasarian and Shavlik (2002; 2003) and the knowledge-based support vector regression method of Mangasarian, Shavlik, and Wild (2004), while performing approximately as well as these more complex approaches. Experiments using our new approach on a synthetic task and a reinforcement-learning problem within the RoboCup soccer simulator show that our advice-taking method can significantly outperform a method without advice and perform similarly to prior advice-taking, support-vector machines.