A decoupled approach to exemplar-based unsupervised learning

  • Authors:
  • Sebastian Nowozin;Gökhan Bakir

  • Affiliations:
  • Max Planck Institute for Biological Cybernetics, Tübingen, Germany;Google GmbH, Zurich, Switzerland

  • Venue:
  • Proceedings of the 25th international conference on Machine learning
  • Year:
  • 2008
  • Convex coding

    UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence

Quantified Score

Hi-index 0.00

Visualization

Abstract

A recent trend in exemplar based unsupervised learning is to formulate the learning problem as a convex optimization problem. Convexity is achieved by restricting the set of possible prototypes to training exemplars. In particular, this has been done for clustering, vector quantization and mixture model density estimation. In this paper we propose a novel algorithm that is theoretically and practically superior to these convex formulations. This is possible by posing the unsupervised learning problem as a single convex "master problem" with non-convex subproblems. We show that for the above learning tasks the subproblems are extremely well-behaved and can be solved efficiently.