A Semi-supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

Authors:
Zhiwu Lu;Yuxin Peng
Affiliations:
Institute of Computer Science and Technology, Peking University, Beijing, P.R. China 100871;Institute of Computer Science and Technology, Peking University, Beijing, P.R. China 100871
Venue:
Neural Processing Letters
Year:
2008

Citing 6
Cited 2

Texture Features for Browsing and Retrieval of Image Data

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Generative/Discriminative Learning Algorithm for Image Classification

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
A regularized minimum cross-entropy algorithm on mixtures of experts for time series prediction and curve detection

Pattern Recognition Letters
Entropy Regularized Likelihood Learning on Gaussian Mixture: Two Gradient Implementations for Automatic Model Selection

Neural Processing Letters
Letters: An iterative algorithm for entropy regularized likelihood learning on Gaussian mixture with automatic model selection

Neurocomputing
Asymptotic convergence properties of the EM algorithm with respect to the overlap in the mixture

Neurocomputing

On EM Estimation for Mixture of Multivariate t-Distributions

Neural Processing Letters
Constrained spectral clustering via exhaustive and efficient constraint propagation

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI

Quantified Score

Hi-index	0.02

Visualization

Abstract

In Gaussian mixture modeling, it is crucial to select the number of Gaussians for a sample set, which becomes much more difficult when the overlap in the mixture is larger. Under regularization theory, we aim to solve this problem using a semi-supervised learning algorithm through incorporating pairwise constraints into entropy regularized likelihood (ERL) learning which can make automatic model selection for Gaussian mixture. The simulation experiments further demonstrate that the presented semi-supervised learning algorithm (i.e., the constrained ERL learning algorithm) can automatically detect the number of Gaussians with a good parameter estimation, even when two or more actual Gaussians in the mixture are overlapped at a high degree. Moreover, the constrained ERL learning algorithm leads to some promising results when applied to iris data classification and image database categorization.