A new perspective on an old perceptron algorithm

  • Authors:
  • Shai Shalev-Shwartz;Yoram Singer

  • Affiliations:
  • School of Computer Sci. & Eng., The Hebrew University, Jerusalem, Israel;School of Computer Sci. & Eng., The Hebrew University, Jerusalem, Israel

  • Venue:
  • COLT'05 Proceedings of the 18th annual conference on Learning Theory
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a generalization of the Perceptron algorithm. The new algorithm performs a Perceptron-style update whenever the margin of an example is smaller than a predefined value. We derive worst case mistake bounds for our algorithm. As a byproduct we obtain a new mistake bound for the Perceptron algorithm in the inseparable case. We describe a multiclass extension of the algorithm. This extension is used in an experimental evaluation in which we compare the proposed algorithm to the Perceptron algorithm.