Improving visualization, scalability and performance of multiclass problems with SVM manifold learning

  • Authors:
  • Catarina Silva;Bernardete Ribeiro

  • Affiliations:
  • School of Technology and Management, Polytechnic Institute of Leiria, Portugal and Dep. Informatics Eng., Center Informatics and Systems, Univ. of Coimbra, Portugal;Dep. Informatics Eng., Center Informatics and Systems, Univ. of Coimbra, Portugal

  • Venue:
  • ICANNGA'09 Proceedings of the 9th international conference on Adaptive and natural computing algorithms
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a learning framework to address multiclass challenges, namely visualization, scalability and performance. We focus on supervised problems by presenting an approach that uses prior information about training labels, manifold learning and support vector machines (SVMs). We employ manifold learning as a feature reduction step, nonlinearly embedding data in a low dimensional space using Isomap (IsometricMapping), enhancing geometric characteristics and preserving the geodesic distance within the manifold. Structured SVMs are used in a multiclass setting with benefits for final multiclass classification in this reduced space. Results on a text classification toy example and on ISOLET, an isolated letter speech recognition problem, demonstrate the remarkable visualization capabilities of the method for multiclass problems in the severely reduced space, whilst improving SVMs baseline performance.