Resampling Method for Unsupervised Estimation of Cluster Validity

Authors:
Erel Levine;Eytan Domany
Affiliations:
Department of Physics of Complex Systems, Weizmann Institute of Science, Rehovot 76100, Israel;Department of Physics of Complex Systems, Weizmann Institute of Science, Rehovot 76100, Israel
Venue:
Neural Computation
Year:
2001

Citing 7
Cited 57

Bootstrap technique in cluster analysis

Pattern Recognition
Algorithms for clustering data

Algorithms for clustering data
Introduction to statistical pattern recognition (2nd ed.)

Introduction to statistical pattern recognition (2nd ed.)
Elements of information theory

Elements of information theory
Pattern Recognition with Fuzzy Objective Function Algorithms

Pattern Recognition with Fuzzy Objective Function Algorithms
Cluster Validation with Generalized Dunn's Indices

ANNES '95 Proceedings of the 2nd New Zealand Two-Stream International Conference on Artificial Neural Networks and Expert Systems
On cluster validity for the fuzzy c-means model

IEEE Transactions on Fuzzy Systems

Stability-Based Model Order Selection in Clustering with Applications to Gene Expression Data

ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
Consensus Clustering: A Resampling-Based Method for Class Discovery and Visualization of Gene Expression Microarray Data

Machine Learning
Bagging for Path-Based Clustering

IEEE Transactions on Pattern Analysis and Machine Intelligence
Stability-based validation of clustering solutions

Neural Computation
Cluster Analysis for Gene Expression Data: A Survey

IEEE Transactions on Knowledge and Data Engineering
Document clustering based on cluster validation

Proceedings of the thirteenth ACM international conference on Information and knowledge management
Simulated Annealing Using a Reversible Jump Markov Chain Monte Carlo Algorithm for Fuzzy Clustering

IEEE Transactions on Knowledge and Data Engineering
Comparing Subspace Clusterings

IEEE Transactions on Knowledge and Data Engineering
MACLAW: A modular approach for clustering with local attribute weighting

Pattern Recognition Letters - Special issue: Evolutionary computer vision and image understanding
Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization

IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning word senses with feature selection and order identification capabilities

ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Using cluster validation criterion to identify optimal feature subset and cluster number for document clustering

Information Processing and Management: an International Journal
Performance of data resampling methods for robust class discovery based on clustering

Intelligent Data Analysis
Learning model order from labeled and unlabeled data for partially supervised classification, with application to word sense disambiguation

Computer Speech and Language
Clustering and aggregation of relational data with applications to image database categorization

Pattern Recognition
Inappropriateness of the criterion of k-way normalized cuts for deciding the number of clusters

Pattern Recognition Letters
A density-based cluster validity approach using multi-representatives

Pattern Recognition Letters
A statistical model of cluster stability

Pattern Recognition
Stability Based Sparse LSI/PCA: Incorporating Feature Selection in LSI and PCA

ECML '07 Proceedings of the 18th European conference on Machine Learning
Resampling-based selective clustering ensembles

Pattern Recognition Letters
Multidimensional cluster stability analysis from a Brazilian Bradyrhizobium sp. RFLP/PCR data set

Journal of Computational and Applied Mathematics
Fuzzy cluster stability analysis with missing values using resampling

International Journal of Bioinformatics Research and Applications
Improving clustering stability with combinatorial MRFs

Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
How Much True Structure Has Been Discovered?

MLDM '09 Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition
Partially supervised sense disambiguation by learning sense number from tagged and untagged corpora

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Accelerating fuzzy clustering

Information Sciences: an International Journal
I2R: three systems for word sense discrimination, Chinese word sense disambiguation, and English word sense disambiguation

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Randomized maps for assessing the reliability of patients clusters in DNA microarray data analyses

Artificial Intelligence in Medicine
Loevinger's measures of rule quality for assessing cluster stability

Computational Statistics & Data Analysis
A selection model for optimal fuzzy clustering algorithm and number of clusters based on competitive comprehensive fuzzy evaluation

IEEE Transactions on Fuzzy Systems
A linguistic approach to classification of bacterial genomes

Pattern Recognition
A stability based validity method for fuzzy clustering

Pattern Recognition
Data-Fusion in Clustering Microarray Data: Balancing Discovery and Interpretability

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Chinese multi-document summarization using adaptive clustering and global search strategy

PRICAI'06 Proceedings of the 9th Pacific Rim international conference on Artificial intelligence
A method for aggregating partitions, applications in K.D.D.

PAKDD'03 Proceedings of the 7th Pacific-Asia conference on Advances in knowledge discovery and data mining
Stability of k-means clustering

COLT'07 Proceedings of the 20th annual conference on Learning theory
Clustering Stability: An Overview

Foundations and Trends® in Machine Learning
An unsupervised aspect-sentiment model for online reviews

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Stability-based validation of bicluster solutions

Pattern Recognition
Ensemble clustering in the belief functions framework

International Journal of Approximate Reasoning
A randomized algorithm for estimating the number of clusters

Automation and Remote Control
MiniMax ε-stable cluster validity index for Type-2 fuzziness

Information Sciences: an International Journal
Multi-document summarization using a clustering-based hybrid strategy

AIRS'06 Proceedings of the Third Asia conference on Information Retrieval Technology
Automatic relation extraction with model order selection and discriminative label identification

IJCNLP'05 Proceedings of the Second international joint conference on Natural Language Processing
A coevolutionary approach for clustering with feature weighting application to image analysis

EC'05 Proceedings of the 3rd European conference on Applications of Evolutionary Computing
Algorithmic paradigms for stability-based cluster validity and model selection statistical methods, with applications to microarray data analysis

Theoretical Computer Science
A novel clustering-based approach to schema matching

ADVIS'06 Proceedings of the 4th international conference on Advances in Information Systems
Stability-based model selection for high throughput genomic data: an algorithmic paradigm

ICARIS'12 Proceedings of the 11th international conference on Artificial Immune Systems
A meta-learning approach for determining the number of clusters with consideration of nearest neighbors

Information Sciences: an International Journal
Random walk distances in data clustering and applications

Advances in Data Analysis and Classification
Data weighing mechanisms for clustering ensembles

Computers and Electrical Engineering
Self-learning K-means clustering: a global optimization approach

Journal of Global Optimization
Instability and cluster stability variance for real clusterings

Information Sciences: an International Journal
Reporting and analyzing alternative clustering solutions by employing multi-objective genetic algorithm and conducting experiments on cancer data

Knowledge-Based Systems
Variational learning of finite Dirichlet mixture models using component splitting

Neurocomputing
Effects of resampling method and adaptation on clustering ensemble efficacy

Artificial Intelligence Review
A binomial noised model for cluster validation

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology - Recent Advances in Soft Computing: Theories and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce a method for validation of results obtained by clustering analysis of data. The method is based on resampling the available data. A figure of merit that measures the stability of clustering solutions against resampling is introduced. Clusters that are stable against resampling give rise to local maxima of this figure of merit. This is presented first for a one-dimensional data set, for which an analytic approximation for the figure of merit is derived and compared with numerical measurements. Next, the applicability of the method is demonstrated for higher-dimensional data, including gene microarray expression data.