Variational bayes estimation of mixing coefficients

Authors:
Bo Wang;D. M. Titterington
Affiliations:
Department of Statistics, University of Glasgow, Glasgow, UK;Department of Statistics, University of Glasgow, Glasgow, UK
Venue:
Proceedings of the First international conference on Deterministic and Statistical Methods in Machine Learning
Year:
2004

Citing 4
Cited 1

An introduction to variational methods for graphical models

Learning in graphical models
Bayesian parameter estimation via variational methods

Statistics and Computing
Convergence and asymptotic normality of variational Bayesian approximations for exponential family models with missing values

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Inferring parameters and structure of latent variable models by variational bayes

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence

Some aspects of latent structure analysis

SLSFS'05 Proceedings of the 2005 international conference on Subspace, Latent Structure and Feature Selection

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate theoretically some properties of variational Bayes approximations based on estimating the mixing coefficients of known densities. We show that, with probability 1 as the sample size n grows large, the iterative algorithm for the variational Bayes approximation converges locally to the maximum likelihood estimator at the rate of O(1/n). Moreover, the variational posterior distribution for the parameters is shown to be asymptotically normal with the same mean but a different covariance matrix compared with those for the maximum likelihood estimator. Furthermore we prove that the covariance matrix from the variational Bayes approximation is ‘too small' compared with that for the MLE, so that resulting interval estimates for the parameters will be unrealistically narrow.