The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

Authors:
Hengyu Wang;Lei Li;Jinwen Ma
Affiliations:
Department of Information Science, School of Mathematical Sciences and LAMA, Peking University, Beijing, China 100871;Department of Information Science, School of Mathematical Sciences and LAMA, Peking University, Beijing, China 100871;Department of Information Science, School of Mathematical Sciences and LAMA, Peking University, Beijing, China 100871
Venue:
ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Theoretical and Methodological Issues
Year:
2008

Citing 6
Cited 0

Algorithms for clustering data

Algorithms for clustering data
Unsupervised Learning of Finite Mixture Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
BYY harmony learning, structural RPCL, and topological self-organizing on mixture models

Neural Networks - New developments in self-organizing maps
BYY Harmony Learning on Finite Mixture: Adaptive Gradient Implementation and A Floating RPCL Mechanism

Neural Processing Letters
The BYY annealing learning algorithm for Gaussian mixture with automated model selection

Pattern Recognition
A fast fixed-point BYY harmony learning algorithm on Gaussian mixture with automated model selection

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

Gaussian mixture has been widely used for data modeling and analysis and the EM algorithm is generally employed for its parameter learning. However, the EM algorithm may be trapped into a local maximum of the likelihood and even leads to a wrong result if the number of components is not appropriately set. Recently, the competitive EM (CEM) algorithm for Gaussian mixtures, a new kind of split-and-merge learning algorithm with certain competitive mechanism on estimated components of the EM algorithm, has been constructed to overcome these drawbacks. In this paper, we construct a new CEM algorithm through the Bayesian Ying-Yang (BYY) harmony stop criterion, instead of the previously used MML criterion. It is demonstrated by the simulation experiments that our proposed CEM algorithm outperforms the original one on both model selection and parameter estimation.