A Spectral Algorithm for Learning Mixtures of Distributions

  • Authors:
  • Santosh Vempala;Grant Wang

  • Affiliations:
  • -;-

  • Venue:
  • FOCS '02 Proceedings of the 43rd Symposium on Foundations of Computer Science
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We show that a simple spectral algorithm for learning a mixture of k spherical Gaussians in Rn works remarkably well 驴 it succeeds in identifying the Gaussians assuming essentially the minimum possible separation between their centers that keeps them unique (solving an open problem of [1]). The sample complexity and running time are polynomial in both n and k. The algorithm also works for the more general problem of learning a mixture of "weakly isotropic" distributions (e.g. a mixture of uniform distributions on cubes).