Estimation for the number of components in a mixture model using stepwise split-and-merge EM algorithm

  • Authors:
  • Hai Xian Wang;Bin Luo;Quan Bing Zhang;Sui Wei

  • Affiliations:
  • Key Lab of Intelligent Computing and Signal Processing of Ministry of Education, School of Computer Science and Technology, Anhul University, Huangshan Road, Hefei 230039, People's Republic of Chi ...;Key Lab of Intelligent Computing and Signal Processing of Ministry of Education, School of Computer Science and Technology, Anhul University, Huangshan Road, Hefei 230039, People's Republic of Chi ...;Key Lab of Intelligent Computing and Signal Processing of Ministry of Education, School of Computer Science and Technology, Anhul University, Huangshan Road, Hefei 230039, People's Republic of Chi ...;Key Lab of Intelligent Computing and Signal Processing of Ministry of Education, School of Computer Science and Technology, Anhul University, Huangshan Road, Hefei 230039, People's Republic of Chi ...

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2004

Quantified Score

Hi-index 0.10

Visualization

Abstract

The main difficulty with EM algorithm for mixture model concerns the number of components, say g. This is the question of model selection, and the EM algorithm itself could not estimate g. On the contrary, the algorithm requires g to be specified before the remaining parameters can be estimated. To solve this problem, a new algorithm, which is called stepwise split-and-merge EM (SSMEM) algorithm, is proposed. The SSMEM algorithm alternately splits and merges components, estimating g and other parameters of components simultaneously. Also, two novel criteria are introduced to efficiently select the components for split or merge. Experimental results on simulated and real data demonstrate the effectivity of the proposed algorithm.