Products of Gaussians and probabilistic minor component analysis

  • Authors:
  • C. K. I. Williams;F. V. Agakov

  • Affiliations:
  • Division of Informatics, University of Edinburgh, Edinburgh EH1 2QL, U.K.;System Engineering Research Group, Chair of Manufacturing Technology Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany

  • Venue:
  • Neural Computation
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recently, Hinton introduced the products of experts architecture for density estimation, where individual expert probabilities are multiplied and renormalized. We consider products of gaussian "pancakes" equally elongated in all directions except one and prove that the maximum likelihood solution for the model gives rise to a minor component analysis solution. We also discuss the covariance structure of sums and products of gaussian pancakes or one-factor probabilistic principal component analysis models.