Prototype based classification using information theoretic learning

  • Authors:
  • Th. Villmann;B. Hammer;F. -M. Schleif;T. Geweniger;T. Fischer;M. Cottrell

  • Affiliations:
  • Medical Department, University Leipzig, Germany;Inst. of Computer Science, Clausthal University of Technology, Germany;Inst. of Computer Science, University Leipzig, Germany;Inst. of Computer Science, University Leipzig, Germany;Inst. of Computer Science, University Leipzig, Germany;University Paris I Sorbonne-Panthéon, SAMOS, France

  • Venue:
  • ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article we extend the (recently published) unsupervised information theoretic vector quantization approach based on the Cauchy–Schwarz-divergence for matching data and prototype densities to supervised learning and classification. In particular, first we generalize the unsupervised method to more general metrics instead of the Euclidean, as it was used in the original algorithm. Thereafter, we extend the model to a supervised learning method resulting in a fuzzy classification algorithm. Thereby, we allow fuzzy labels for both, data and prototypes. Finally, we transfer the idea of relevance learning for metric adaptation known from learning vector quantization to the new approach.