Information processing in dynamical systems: foundations of harmony theory
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Learning and relearning in Boltzmann machines
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Connectionist learning of belief networks
Artificial Intelligence
Using Generative Models for Handwritten Digit Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
A maximum entropy approach to natural language processing
Computational Linguistics
Bias/variance decompositions for likelihood-based estimators
Neural Computation
Learning continuous attractors in recurrent networks
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
A hierarchical community of experts
Learning in graphical models
Attractor Dynamics in Feedforward Neural Networks
Neural Computation
Energy-based models for sparse overcomplete representations
The Journal of Machine Learning Research
Feature selection, L1 vs. L2 regularization, and rotational invariance
ICML '04 Proceedings of the twenty-first international conference on Machine learning
The multiple multiplicative factor model for collaborative filtering
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Reinforcement Learning with Factored States and Actions
The Journal of Machine Learning Research
Bayesian learning in undirected graphical models: approximate MCMC algorithms
UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Energy-based models for sparse overcomplete representations
The Journal of Machine Learning Research
Learning physics-based motion style with nonlinear inverse optimization
ACM SIGGRAPH 2005 Papers
Topographic Product Models Applied to Natural Scene Statistics
Neural Computation
International Journal of Computer Vision
The rate adapting poisson model for information retrieval and object recognition
ICML '06 Proceedings of the 23rd international conference on Machine learning
Combining discriminative features to infer complex trajectories
ICML '06 Proceedings of the 23rd international conference on Machine learning
A fast learning algorithm for deep belief nets
Neural Computation
Some extensions of score matching
Computational Statistics & Data Analysis
A Maximum-Likelihood Interpretation for Slow Feature Analysis
Neural Computation
The Journal of Machine Learning Research
On the Spatial Statistics of Optical Flow
International Journal of Computer Vision
An empirical evaluation of deep architectures on problems with many factors of variation
Proceedings of the 24th international conference on Machine learning
Three new graphical models for statistical language modelling
Proceedings of the 24th international conference on Machine learning
Restricted Boltzmann machines for collaborative filtering
Proceedings of the 24th international conference on Machine learning
Dynamic hierarchical Markov random fields and their application to web data extraction
Proceedings of the 24th international conference on Machine learning
Generalized component analysis for text with heterogeneous attributes
Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Learning-based nonparametric image super-resolution
EURASIP Journal on Applied Signal Processing
Integration of Stochastic Models by Minimizing α-Divergence
Neural Computation
Statistical Characterization of Protein Ensembles
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
A principle for learning egocentric-allocentric transformation
Neural Computation
Classification using discriminative restricted Boltzmann machines
Proceedings of the 25th international conference on Machine learning
On the quantitative analysis of deep belief networks
Proceedings of the 25th international conference on Machine learning
Training restricted Boltzmann machines using approximations to the likelihood gradient
Proceedings of the 25th international conference on Machine learning
Contrastive divergence in gaussian diffusions
Neural Computation
Efficient Weight Learning for Markov Logic Networks
PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Approximate Parameter Learning in Conditional Random Fields: An Empirical Investigation
Proceedings of the 30th DAGM symposium on Pattern Recognition
Self-organized Reinforcement Learning Based on Policy Gradient in Nonstationary Environments
ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Dynamic Hierarchical Markov Random Fields for Integrated Web Data Extraction
The Journal of Machine Learning Research
Deep, narrow sigmoid belief networks are universal approximators
Neural Computation
Deep networks for image retrieval on large-scale databases
MM '08 Proceedings of the 16th ACM international conference on Multimedia
An Improved FoE Model for Image Deblurring
International Journal of Computer Vision
Exploring Music Video Editing Rules with Dual-Wing Harmonium Model
PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Dynamic Programming Algorithms as Products of Weighted Logic Programs
ICLP '08 Proceedings of the 24th International Conference on Logic Programming
Mining Association Patterns between Music and Video Clips in Professional MTV
MMM '09 Proceedings of the 15th International Multimedia Modeling Conference on Advances in Multimedia Modeling
International Journal of Computer Vision
Estimating Markov Random Field Potentials for Natural Images
ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
A Discriminative Approach to Topic-Based Citation Recommendation
PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Joint trajectory tracking and recognition based on bi-directional nonlinear learning
Image and Vision Computing
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Large-scale deep unsupervised learning using graphics processors
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Factored conditional restricted Boltzmann Machines for modeling motion style
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Using fast weights to improve persistent contrastive divergence
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Herding dynamical weights to learn
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
International Journal of Approximate Reasoning
A new dual wing harmonium model for document retrieval
Pattern Recognition
Justifying and generalizing contrastive divergence
Neural Computation
A multiclass classification method based on decoding of binary classifiers
Neural Computation
Multi-conditional learning: generative/discriminative training for clustering and classification
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Models for patch-based image restoration
Journal on Image and Video Processing - Special issue on patches in vision
Two-Way Grouping by One-Way Topic Models
IDA '09 Proceedings of the 8th International Symposium on Intelligent Data Analysis: Advances in Intelligent Data Analysis VIII
Max-Margin Weight Learning for Markov Logic Networks
ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I
Object Detection by Estimating and Combining High-Level Features
ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
A computational model of the cerebral cortex
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Joint inference in information extraction
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
Image modeling using tree structured conditional random fields
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
Approximate learning algorithm in boltzmann machines
Neural Computation
What kind of a graphical model is the brain?
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Learning Deep Architectures for AI
Foundations and Trends® in Machine Learning
Paraphrase identification as probabilistic quasi-synchronous recognition
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Minimising Contrastive Divergence with Dynamic Current Mirrors
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
Learning super resolution with global and local constraints
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
A Study of Parts-Based Object Class Detection Using Complete Graphs
International Journal of Computer Vision
Training an active random field for real-time image denoising
IEEE Transactions on Image Processing
A novel dual wing harmonium model aided by 2-D wavelet transform subbands for document data mining
Expert Systems with Applications: An International Journal
Why Does Unsupervised Pre-training Help Deep Learning?
The Journal of Machine Learning Research
On the number of modes of a Gaussian mixture
Scale Space'03 Proceedings of the 4th international conference on Scale space methods in computer vision
Adaptive stochastic classifier for noisy pH-ISFET measurements
ICANN/ICONIP'03 Proceedings of the 2003 joint international conference on Artificial neural networks and neural information processing
Gamma Markov random fields for audio source modeling
IEEE Transactions on Audio, Speech, and Language Processing
A two-layer ICA-like model estimated by score matching
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Interpretation and generalization of score matching
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Products of Hidden Markov Models: it takes N1 to tango
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Ordinal Boltzmann Machines for collaborative filtering
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Herding dynamic weights for partially observed random field models
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Context based object categorization: A critical survey
Computer Vision and Image Understanding
Interpolating fine texturess with fields of experts prior
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Deep belief networks are compact universal approximators
Neural Computation
An emotion generation model based on random graphs
International Journal of Computer Applications in Technology
Products of random latent variable grammars
HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Modeling semantic relevance for question-answer pairs in web social communities
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Unsupervised Layer-Wise Model Selection in Deep Neural Networks
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
A two-layer model of natural stimuli estimated with score matching
Neural Computation
Using deep belief nets for Chinese named entity categorization
NEWS '10 Proceedings of the 2010 Named Entities Workshop
Crouching Dirichlet, hidden Markov model: unsupervised POS tagging with context local tag generation
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Comparing classification methods for longitudinal fmri studies
Neural Computation
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
Large scale problem solving with neural networks: the netflix prize case
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
Modeling and analysis of dynamic behaviors of web image collections
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Convolutional learning of spatio-temporal features
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Learning to detect roads in high-resolution aerial images
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Multiscale conditional random fields for image labeling
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Research frontier: deep machine learning--a new frontier in artificial intelligence research
IEEE Computational Intelligence Magazine
Sparse deep belief net for handwritten digits classification
AICI'10 Proceedings of the 2010 international conference on Artificial intelligence and computational intelligence: Part I
Deep adaptive networks for image classification
ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
A novel text classification approach based on deep belief network
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
Neural decoding with hierarchical generative models
Neural Computation
Active deep networks for semi-supervised sentiment classification
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
The Journal of Machine Learning Research
Exploiting local structure in Boltzmann machines
Neurocomputing
Products of weighted logic programs
Theory and Practice of Logic Programming
A description of a simulation environment and neural architecture for a-life
ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Lost in binarization: query-adaptive ranking for similar image search with compact codes
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Generalized darting Monte Carlo
Pattern Recognition
A connection between score matching and denoising autoencoders
Neural Computation
Quickly generating representative samples from an rbm-derived process
Neural Computation
Unsupervised learning of hierarchical representations with convolutional deep belief networks
Communications of the ACM
Domain adaptation by constraining inter-domain variability of latent feature representation
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Temporal restricted Boltzmann machines for dependency parsing
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Canadian AI'11 Proceedings of the 24th Canadian conference on Advances in artificial intelligence
Two Distributed-State Models For Generating High-Dimensional Time Series
The Journal of Machine Learning Research
Learning features for human action recognition using multilayer architectures
IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs
ACM Transactions on Asian Language Information Processing (TALIP)
Stacked convolutional auto-encoders for hierarchical feature extraction
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Weakly supervised learning of foreground-background segmentation using masked RBMs
ICANN'11 Proceedings of the 21st international conference on Artificial neural networks - Volume Part II
Technical Section: Neural network-based symbol recognition using a few labeled samples
Computers and Graphics
Restricted deep belief networks for multi-view learning
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Comparing probabilistic models for melodic sequences
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part III
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
Bilinear deep learning for image classification
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Discovering multiple constraints that are frequently approximately satisfied
UAI'01 Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence
In All Likelihood, Deep Belief Is Not Enough
The Journal of Machine Learning Research
Learning and incorporating top-down cues in image segmentation
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Boltzmann machine learning with the latent maximum entropy principle
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Predictive coding as a model of the V1 saliency map hypothesis
Neural Networks
Detection of mine-like objects using restricted boltzmann machines
AI'10 Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence
Discovering morphological paradigms from plain text using a Dirichlet process mixture model
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Probabilistic models of similarity in syntactic context
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Exploiting inference for approximate parameter learning in discriminative fields: an empirical study
EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Semi-supervised learning for image annotation based on conditional random fields
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Efficient belief propagation with learned higher-order markov random fields
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Attentiveness detection using continuous restricted boltzmann machine in e-learning environment
ICHL'09 Proceedings of the Second international conference on Hybrid Learning and Education
Block-based Deep Belief Networks for face recognition
International Journal of Biometrics
Models of visually guided routes in ants: embodiment simplifies route acquisition
ICIRA'11 Proceedings of the 4th international conference on Intelligent Robotics and Applications - Volume Part II
Structured Learning and Prediction in Computer Vision
Foundations and Trends® in Computer Graphics and Vision
The Journal of Machine Learning Research
Learning algorithms for the classification restricted Boltzmann machine
The Journal of Machine Learning Research
Detonation Classification from Acoustic Signature with the Restricted Boltzmann Machine
Computational Intelligence
A neural-symbolic cognitive agent for online learning and reasoning
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
An efficient learning procedure for deep boltzmann machines
Neural Computation
Learning where to attend with deep architectures for image tracking
Neural Computation
Learning a generative model of images by factoring appearance and shape
Neural Computation
Bounding the bias of contrastive divergence learning
Neural Computation
The impact of images on user clicks in product search
Proceedings of the Twelfth International Workshop on Multimedia Data Mining
Manhattan hashing for large-scale image retrieval
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
WCCI'12 Proceedings of the 2012 World Congress conference on Advances in Computational Intelligence
3D shape estimation in video sequences provides high precision evaluation of facial expressions
Image and Vision Computing
Use of contexts in language model interpolation and adaptation
Computer Speech and Language
Shared components topic models
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Sleep stage classification using unsupervised feature learning
Advances in Artificial Neural Systems - Special issue on Advances in Unsupervised Learning Techniques Applied to Biosciences and Medicine
Higher-order constituent parsing and parser combination
ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
Annotating images with suggestions: user study of a tagging system
ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
Unsupervised and supervised visual codes with restricted boltzmann machines
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
GPU-accelerated restricted boltzmann machine for collaborative filtering
ICA3PP'12 Proceedings of the 12th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
Lifted online training of relational models with stochastic gradient methods
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Pavement distress image recognition based on multilayer autoencoders
AICI'12 Proceedings of the 4th international conference on Artificial Intelligence and Computational Intelligence
Training restricted boltzmann machines with multi-tempering: harnessing parallelization
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Tikhonov-Type regularization for restricted boltzmann machines
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part I
Hierarchical k-means algorithm for modeling visual area v2 neurons
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Energy-based temporal neural networks for imputing missing values
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
Forecasting large scale conditional volatility and covariance using neural network on GPU
The Journal of Supercomputing
Enhanced gradient for training restricted boltzmann machines
Neural Computation
Language model cross adaptation for LVCSR system combination
Computer Speech and Language
Probabilistic color-by-numbers: suggesting pattern colorizations using factor graphs
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Multi-objective optimization with estimation of distribution algorithm in a noisy environment
Evolutionary Computation
Multi-source deep learning for information trustworthiness estimation
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Convolutional Deep Networks for Visual Data Classification
Neural Processing Letters
Tracking with a mixed continuous-discrete Conditional Random Field
Computer Vision and Image Understanding
Training restricted Boltzmann machines: An introduction
Pattern Recognition
Deep feature learning using target priors with applications in ECoG signal decoding for BCI
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Multi-modal distance metric learning
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Combine constituent and dependency parsing via reranking
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Learning ensemble classifiers via restricted Boltzmann machines
Pattern Recognition Letters
Training energy-based models for time-series imputation
The Journal of Machine Learning Research
Probabilistic Joint Image Segmentation and Labeling by Figure-Ground Composition
International Journal of Computer Vision
Expert Systems with Applications: An International Journal
The Shape Boltzmann Machine: A Strong Model of Object Shape
International Journal of Computer Vision
Hi-index | 0.02 |
It is possible to combine multiple latent-variable models of the same data by multiplying their probability distributions together and then renormalizing. This way of combining individual "expert" models makes it hard to generate samples from the combined model but easy to infer the values of the latent variables of each expert, because the combination rule ensures that the latent variables of different experts are conditionally independent when given the data. A product of experts (PoE) is therefore an interesting candidate for a perceptual system in which rapid inference is vital and generation is unnecessary. Training a PoE by maximizing the likelihood of the data is difficult because it is hard even to approximate the derivatives of the renormalization term in the combination rule. Fortunately, a PoE can be trained using a different objective function called "contrastive divergence" whose derivatives with regard to the parameters can be approximated accurately and efficiently. Examples are presented of contrastive divergence learning using several types of expert on several types of data.