Particle filters for mixture models with an unknown number of components

  • Authors:
  • Paul Fearnhead

  • Affiliations:
  • Department of Mathematics and Statistics, Lancaster University, Lancaster, LA1 4YF

  • Venue:
  • Statistics and Computing
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the analysis of data under mixture models where the number of components in the mixture is unknown. We concentrate on mixture Dirichlet process models, and in particular we consider such models under conjugate priors. This conjugacy enables us to integrate out many of the parameters in the model, and to discretize the posterior distribution. Particle filters are particularly well suited to such discrete problems, and we propose the use of the particle filter of Fearnhead and Clifford for this problem. The performance of this particle filter, when analyzing both simulated and real data from a Gaussian mixture model, is uniformly better than the particle filter algorithm of Chen and Liu. In many situations it outperforms a Gibbs Sampler. We also show how models without the required amount of conjugacy can be efficiently analyzed by the same particle filter algorithm.