High-Dimensional Unsupervised Selection and Estimation of a Finite Generalized Dirichlet Mixture Model Based on Minimum Message Length

Authors:
Nizar Bouguila;Djemel Ziou
Affiliations:
-;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2007

Citing 28
Cited 26

Sum and Difference Histograms for Texture Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Sphere-packings, lattices, and groups

Sphere-packings, lattices, and groups
Automatic text processing: the transformation, analysis, and retrieval of information by computer

Automatic text processing: the transformation, analysis, and retrieval of information by computer
Classification by minimum-message-length inference

ICCI'90 Proceedings of the international conference on Advances in computing and information
Photobook: content-based manipulation of image databases

International Journal of Computer Vision
VisualSEEk: a fully automated content-based image query system

MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Bayesian Approaches to Gaussian Mixture Modeling

IEEE Transactions on Pattern Analysis and Machine Intelligence
Filtering for Texture Classification: A Comparative Study

IEEE Transactions on Pattern Analysis and Machine Intelligence
Generalized Dirichlet distribution in Bayesian analysis

Applied Mathematics and Computation
On finding the number of clusters

Pattern Recognition Letters
Statistical Pattern Recognition: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Unsupervised Learning of Finite Mixture Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Inference in model-based cluster analysis

Statistics and Computing
Finding overlapping components with MML

Statistics and Computing
Model selection for probabilistic clustering using cross-validatedlikelihood

Statistics and Computing
MML clustering of multi-state, Poisson, vonMises circular and Gaussian distributions

Statistics and Computing
Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying

IEEE Transactions on Pattern Analysis and Machine Intelligence
MML Clustering of Continuous-Valued Data Using Gaussian and t Distributions

AI '02 Proceedings of the 15th Australian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence
Single Factor Analysis in MML Mixture Modelling

PAKDD '98 Proceedings of the Second Pacific-Asia Conference on Research and Development in Knowledge Discovery and Data Mining
Image Indexing Using Color Correlograms

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Latent dirichlet allocation

The Journal of Machine Learning Research
A Powreful Finite Mixture Model Based on the Generalized Dirichlet Distribution: Unsupervised Learning and Applications

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Unsupervised Learning of a Finite Gamma Mixture Using MML: Application to SAR Image Analysis

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 2 - Volume 02
Statistical and Inductive Inference by Minimum Message Length (Information Science and Statistics)

Statistical and Inductive Inference by Minimum Message Length (Information Science and Statistics)
MML-Based Approach for High-Dimensional Unsupervised Learning Using the Generalized Dirichlet Mixture

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
The minimum description length principle in coding and modeling

IEEE Transactions on Information Theory
Image classification for content-based indexing

IEEE Transactions on Image Processing
Unsupervised learning of a finite mixture model based on the Dirichlet distribution and its application

IEEE Transactions on Image Processing

Discrete data clustering using finite mixture models

Pattern Recognition
A Graphical Model for Content Based Image Suggestion and Feature Selection

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
A Statistical Model for Histogram Refinement

ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Finite Gamma mixture modelling using minimum message length inference: application to SAR image analysis

International Journal of Remote Sensing
A Statistical Approach for Binary Vectors Modeling and Clustering

PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
A Nonparametric Bayesian Learning Model: Application to Text and Image Categorization

PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
On multivariate binary data clustering and feature weighting

Computational Statistics & Data Analysis
Parameter estimation for generalized Dirichlet distributions from the sample estimates of the first and the second moments of random variables

Computational Statistics & Data Analysis
Model-based subspace clustering of non-Gaussian data

Neurocomputing
A Dirichlet process mixture of generalized Dirichlet distributions for proportional data modeling

IEEE Transactions on Neural Networks
Discrete visual features modeling via leave-one-out likelihood estimation and applications

Journal of Visual Communication and Image Representation
Long-term relevance feedback and feature selection for adaptive content based image suggestion

Pattern Recognition
Simultaneous non-gaussian data clustering, feature selection and outliers rejection

PReMI'11 Proceedings of the 4th international conference on Pattern recognition and machine intelligence
Infinite Liouville mixture models with application to text and texture categorization

Pattern Recognition Letters
A fully Bayesian model based on reversible jump MCMC and finite Beta mixtures for clustering

Expert Systems with Applications: An International Journal
A finite mixture model for simultaneous high-dimensional clustering, localized feature selection and outlier rejection

Expert Systems with Applications: An International Journal
Unsupervised feature and model selection for generalized Dirichlet mixture models

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Generalized Gaussian mixture models as a nonparametric Bayesian approach for clustering using class-specific visual features

Journal of Visual Communication and Image Representation
Deriving kernels from generalized Dirichlet mixture models and applications

Information Processing and Management: an International Journal
Nonparametric localized feature selection via a dirichlet process mixture of generalized dirichlet distributions

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Minimum message length inference and mixture modelling of inverse gaussian distributions

AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Simultaneous Bayesian clustering and feature selection using RJMCMC-based learning of finite generalized Dirichlet mixture models

Signal Processing
Variational learning of a Dirichlet process of generalized Dirichlet distributions for simultaneous clustering and feature selection

Pattern Recognition
Expectation propagation learning of finite Beta-Liouville mixtures for spatio-temporal object recognition

Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Learning finite Beta-Liouville mixture models via variational bayes for proportional data clustering

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Predictive Distribution of the Dirichlet Mixture Model by Local Variational Inference

Journal of Signal Processing Systems

Quantified Score

Hi-index	0.16

Visualization

Abstract

We consider the problem of determining the structure of high-dimensional data, without prior knowledge of the number of clusters. Data are represented by a finite mixture model based on the generalized Dirichlet distribution. The generalized Dirichlet distribution has a more general covariance structure than the Dirichlet distribution and offers high flexibility and ease of use for the approximation of both symmetric and asymmetric distributions. This makes the generalized Dirichlet distribution more practical and useful. An important problem in mixture modeling is the determination of the number of clusters. Indeed, a mixture with too many or too few components may not be appropriate to approximate the true model. Here, we consider the application of the minimum message length (MML) principle to determine the number of clusters. The MML is derived so as to choose the number of clusters in the mixture model which best describes the data. A comparison with other selection criteria is performed. The validation involves synthetic data, real data clustering, and two interesting real applications: classification of web pages, and texture database summarization for efficient retrieval.