Automatic Detection of Learnability under Unreliable and Sparse User Feedback

  • Authors:
  • Yvonne Moh;Wolfgang Einhäuser;Joachim M. Buhmann

  • Affiliations:
  • Institute of Computational Science, Swiss Federal Institute of Technology (ETH) Zurich,;Institute of Computational Science, Swiss Federal Institute of Technology (ETH) Zurich,;Institute of Computational Science, Swiss Federal Institute of Technology (ETH) Zurich,

  • Venue:
  • Proceedings of the 30th DAGM symposium on Pattern Recognition
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Personalization for real-world machine-learning applications usually has to incorporate user feedback. Unfortunately, user feedback often suffers from sparsity and possible inconsistencies. Here we present an algorithm that exploits feedback for learning only when it is consistent. The user provides feedback on a small subset of the data. Based on the data representation alone, our algorithm employs a statistical criterion to trigger learning when user feedback is significantly different from random. We evaluate our algorithm in a challenging audio classification task with relevance to hearing aid applications. By restricting learning to an informative subset, our algorithm substantially improves the performance of a recently introduced classification algorithm.