EM algorithms for PCA and SPCA
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Mixtures of probabilistic principal component analyzers
Neural Computation
Probabilistic latent semantic indexing
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
An Introduction to Variational Methods for Graphical Models
Machine Learning
Learning Curved Multinomial Subfamilies for Natural Language Processing and Information Retrieval
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
The Journal of Machine Learning Research
Sequential information bottleneck for finite data
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Combining Topic Models and Social Networks for Chat Data Mining
WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
A Scalable Topic-Based Open Source Search Engine
WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Exploring Independent Trends in a Topic-Based Search Engine
WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Applying discrete PCA in data analysis
UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Combining eye movements and collaborative filtering for proactive information retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Relation between PLSA and NMF and implications
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Expectation maximization algorithms for conditional likelihoods
ICML '05 Proceedings of the 22nd international conference on Machine learning
The rate adapting poisson model for information retrieval and object recognition
ICML '06 Proceedings of the 23rd international conference on Machine learning
Noisy-OR Component Analysis and its Application to Link Analysis
The Journal of Machine Learning Research
Modeling Semantic Aspects for Cross-Media Image Indexing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Dimension Reduction for Mixtures of Exponential Families
ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Latent grouping models for user preference prediction
Machine Learning
Complexity control in a mixture model by the Hardy-Weinberg equilibrium
Computational Statistics & Data Analysis
Dynamic Exponential Family Matrix Factorization
PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
The VLDB Journal — The International Journal on Very Large Data Bases
Bayesian inference for nonnegative matrix factorisation models
Computational Intelligence and Neuroscience
Contextual classification of image patches with latent aspect models
Journal on Image and Video Processing - Special issue on patches in vision
Two-Way Grouping by One-Way Topic Models
IDA '09 Proceedings of the 8th International Symposium on Intelligent Data Analysis: Advances in Intelligent Data Analysis VIII
Heuristic Bayesian Segmentation for Discovery of Coexpressed Genes within Genomic Regions
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Neurocomputing
Unsupervised Object Discovery: A Comparison
International Journal of Computer Vision
A neural network for text representation
ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Proximal Methods for Hierarchical Sparse Coding
The Journal of Machine Learning Research
PKDD'06 Proceedings of the 10th European conference on Principle and Practice of Knowledge Discovery in Databases
On discriminative joint density modeling
ECML'05 Proceedings of the 16th European conference on Machine Learning
Communications of the ACM
Covariance and PCA for categorical variables
PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Probabilistic latent clustering of device usage
IDA'05 Proceedings of the 6th international conference on Advances in Intelligent Data Analysis
Supervised input space scaling for non-negative matrix factorization
Signal Processing
SLSFS'05 Proceedings of the 2005 international conference on Subspace, Latent Structure and Feature Selection
Constructing visual models with a latent space approach
SLSFS'05 Proceedings of the 2005 international conference on Subspace, Latent Structure and Feature Selection
Stel Component Analysis: Joint Segmentation, Modeling and Recognition of Objects Classes
International Journal of Computer Vision
| Hi-index | 0.02 |
Several authors in recent years have proposed discrete analogues to principle component analysis intended to handle discrete or positive only data, for instance suited to analyzing sets of documents. Methods include non-negative matrix factorization, probabilistic latent semantic analysis, and latent Dirichlet allocation. This paper begins with a review of the basic theory of the variational extension to the expectation-maximization algorithm, and then presents discrete component finding algorithms in that light. Experiments are conducted on both bigram word data and document bag-of-word to expose some of the subtleties of this new class of algorithms.