Designing Model Based Classifiers by Emphasizing Soft Targets

  • Authors:
  • Soufiane El Jelali;Abdelouahid Lyhyaoui;Aníbal R. Figueiras-Vidal

  • Affiliations:
  • Dept. of Signal Processing and Communications, Univ. Carlos III de Madrid Av. de la Universidad 30, Leganés, Madrid 28911, Spain. E-mail: soufiane@tsc.uc3m.es;Dept. of Telecoms and Electronics, ENSA of Tangier, Univ. Abdelmalek Essaâdi B.P. 1818, Tanger Principale, Tangier, Morocco. E-mail: lyhyaoui@gmail.com;Dept. of Signal Processing and Communications, Univ. Carlos III de Madrid Av. de la Universidad 30, Leganés, Madrid 28911, Spain. E-mail: arfv@tsc.uc3m.es

  • Venue:
  • Fundamenta Informaticae - Advances in Artificial Intelligence and Applications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

When training machine classifiers, to replace hard classification targets by emphasized soft versions of them helps to reduce the negative effects of using standard cost functions as approximations to misclassification rates. This emphasis has the same kind of effect as sample editing methods, that have proved to be effective for improving classifiers performance. In this paper, we explore the effectiveness of using emphasized soft targets with generative models, such as Gaussian MixtureModels (GMM), and Gaussian Processes (GP). The interest of using GMMis that they offer advantages such as an easy interpretation and straightforward possibilities to deal with missing values. With respect to GP, if we use soft targets, we do not need to resort to any complex approximation to get a Gaussian Process classifier and, simultaneously, we can obtain the advantages provided by the use of an emphasis. Simulation results support the usefulness of the proposed approach to get better performance and show a low sensitivity to design parameters selection.