Perceptron and SVM learning with generalized cost models

  • Authors:
  • Peter Geibel;Ulf Brefeld;Fritz Wysotzki

  • Affiliations:
  • Methods of Artificial Intelligence, Sekr. Fr 5-8, Faculty IV, TU Berlin, Franklinstr. 28/29, D-10587 Berlin, Germany. Tel.: +49 30 31425491/ Fax: +49 30 31424913/ E-mail: geibel, wysotzki@cs.tu-be ...;Knowledge Management Group, School of Computer Science, Humboldt University, Unter den Linden 6, D-10099 Berlin, Germany. E-mail: brefeld@informatik.hu-berlin.de;Methods of Artificial Intelligence, Sekr. Fr 5-8, Faculty IV, TU Berlin, Franklinstr. 28/29, D-10587 Berlin, Germany. Tel.: +49 30 31425491/ Fax: +49 30 31424913/ E-mail: geibel, wysotzki@cs.tu-be ...

  • Venue:
  • Intelligent Data Analysis
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning algorithms from the fields of artificial neural networks and machine learning, typically, do not take any costs into account or allow only costs depending on the classes of the examples that are used for learning. As an extension of class dependent costs, we consider costs that are example, i.e. feature and class dependent. We derive a cost-sensitive perceptron learning rule for non-separable classes, that can be extended to multi-modal classes (DIPOL) and present a natural cost-sensitive extension of the support vector machine (SVM). We also derive an approach for including example dependent costs into an arbitrary cost-insensitive learning algorithm by sampling according to modified probability distributions.