Component Reduction for Hierarchical Mixture Model Construction

  • Authors:
  • Kumiko Maebashi;Nobuo Suematsu;Akira Hayashi

  • Affiliations:
  • Graduate School of Information Sciences, Hiroshima City University, Hiroshima, Japan 731-3194;Graduate School of Information Sciences, Hiroshima City University, Hiroshima, Japan 731-3194;Graduate School of Information Sciences, Hiroshima City University, Hiroshima, Japan 731-3194

  • Venue:
  • Neural Information Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The mixture modeling framework is widely used in many applications. In this paper, we propose a component reductiontechnique, that collapses a mixture model into a mixture with fewer components. For fitting a mixture model to data, the EM (Expectation-Maximization) algorithm is usually used. Our algorithm is derived by extending mixture model learning using the EM-algorithm.In this extension, a difficulty arises from the fact that some crucial quantities cannot be evaluated analytically. We overcome this difficulty by introducing an effective approximation. The effectiveness of our algorithm is demonstrated by applying it to a simple synthetic component reduction task and a phoneme clustering problem.