Connectionist learning of belief networks
Artificial Intelligence
Boosting a weak learning algorithm by majority
Information and Computation
A view of the EM algorithm that justifies incremental, sparse, and other variants
Proceedings of the NATO Advanced Study Institute on Learning in graphical models
Recognizing Handwritten Digits Using Hierarchical Products of Experts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Training Invariant Support Vector Machines
Machine Learning
Shape Matching and Object Recognition Using Shape Contexts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Training products of experts by minimizing contrastive divergence
Neural Computation
Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis
ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 2
Energy-based models for sparse overcomplete representations
The Journal of Machine Learning Research
Fields of Experts: A Framework for Learning Image Priors
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Toward automatic phenotyping of developing embryos from videos
IEEE Transactions on Image Processing
An empirical evaluation of deep architectures on problems with many factors of variation
Proceedings of the 24th international conference on Machine learning
Three new graphical models for statistical language modelling
Proceedings of the 24th international conference on Machine learning
Restricted Boltzmann machines for collaborative filtering
Proceedings of the 24th international conference on Machine learning
Bayesian independent component analysis: Variational methods and non-negative decompositions
Digital Signal Processing
Visual Recognition and Inference Using Dynamic Overcomplete Sparse Learning
Neural Computation
A principle for learning egocentric-allocentric transformation
Neural Computation
Classification using discriminative restricted Boltzmann machines
Proceedings of the 25th international conference on Machine learning
Semi-supervised learning of compact document representations with deep networks
Proceedings of the 25th international conference on Machine learning
On the quantitative analysis of deep belief networks
Proceedings of the 25th international conference on Machine learning
Training restricted Boltzmann machines using approximations to the likelihood gradient
Proceedings of the 25th international conference on Machine learning
Extracting and composing robust features with denoising autoencoders
Proceedings of the 25th international conference on Machine learning
Deep learning via semi-supervised embedding
Proceedings of the 25th international conference on Machine learning
Sensitivity derivatives for flexible sensorimotor learning
Neural Computation
Structured machine learning: the next ten years
Machine Learning
Topology perserving mappings using cross entropy adaptation
AIKED'08 Proceedings of the 7th WSEAS International Conference on Artificial intelligence, knowledge engineering and data bases
Adding Local Constraints to Bayesian Networks
CAI '07 Proceedings of the 20th conference of the Canadian Society for Computational Studies of Intelligence on Advances in Artificial Intelligence
Toward a Theory of Embodied Statistical Learning
SAB '08 Proceedings of the 10th international conference on Simulation of Adaptive Behavior: From Animals to Animats
Deep, narrow sigmoid belief networks are universal approximators
Neural Computation
Neural network learning of optimal Kalman prediction and control
Neural Networks
The on-line cross entropy method for unsupervised data exploration
WSEAS Transactions on Mathematics
A high-performance FPGA architecture for restricted boltzmann machines
Proceedings of the ACM/SIGDA international symposium on Field programmable gate arrays
A Discriminative Approach to Topic-Based Citation Recommendation
PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Large-scale deep unsupervised learning using graphics processors
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Factored conditional restricted Boltzmann Machines for modeling motion style
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Using fast weights to improve persistent contrastive divergence
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
International Journal of Approximate Reasoning
Justifying and generalizing contrastive divergence
Neural Computation
Deformation-Aware Log-Linear Models
Proceedings of the 31st DAGM Symposium on Pattern Recognition
Refining generative language models using discriminative learning
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
A deep learning approach to machine transliteration
StatMT '09 Proceedings of the Fourth Workshop on Statistical Machine Translation
2009 Special Issue: Cortical circuits for perceptual inference
Neural Networks
LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
Kernel Methods in Computer Vision
Foundations and Trends® in Computer Graphics and Vision
Learning Deep Architectures for AI
Foundations and Trends® in Machine Learning
Almost Random Projection Machine
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
Deep networks for audio event classification in soccer videos
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
It's not you, it's me: detecting flirting and its misperception in speed-dates
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Neural learning of Kalman filtering, Kalman control, and system identification
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Settable Systems: An Extension of Pearl's Causal Model with Optimization, Equilibrium, and Learning
The Journal of Machine Learning Research
Why Does Unsupervised Pre-training Help Deep Learning?
The Journal of Machine Learning Research
Correlated non-parametric latent feature models
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Self-taught hashing for fast similarity search
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Deep belief networks are compact universal approximators
Neural Computation
Unsupervised Layer-Wise Model Selection in Deep Neural Networks
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Large-margin classification in infinite neural networks
Neural Computation
Using deep belief nets for Chinese named entity categorization
NEWS '10 Proceedings of the 2010 Named Entities Workshop
Comparing classification methods for longitudinal fmri studies
Neural Computation
A deep-learning model-based and data-driven hybrid architecture for image annotation
Proceedings of the international workshop on Very-large-scale multimedia corpus, mining and retrieval
Using grammar induction to model adaptive behavior of networks of collaborative agents
ICGI'10 Proceedings of the 10th international colloquium conference on Grammatical inference: theoretical results and applications
Learning of lateral connections for representational invariant recognition
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
Convolutional learning of spatio-temporal features
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Application Feedback in Guiding a Deep-Layered Perception Model
Proceedings of the 2010 conference on Biologically Inspired Cognitive Architectures 2010: Proceedings of the First Annual Meeting of the BICA Society
PCM'10 Proceedings of the Advances in multimedia information processing, and 11th Pacific Rim conference on Multimedia: Part II
Research frontier: deep machine learning--a new frontier in artificial intelligence research
IEEE Computational Intelligence Magazine
High-performance reconfigurable hardware architecture for restricted Boltzmann machines
IEEE Transactions on Neural Networks
Sparse deep belief net for handwritten digits classification
AICI'10 Proceedings of the 2010 international conference on Artificial intelligence and computational intelligence: Part I
Deep adaptive networks for image classification
ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
A novel text classification approach based on deep belief network
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
Neural decoding with hierarchical generative models
Neural Computation
Active deep networks for semi-supervised sentiment classification
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Building a multi-FPGA virtualized restricted boltzmann machine architecture using embedded MPI
Proceedings of the 19th ACM/SIGDA international symposium on Field programmable gate arrays
The Journal of Machine Learning Research
Exploiting local structure in Boltzmann machines
Neurocomputing
Predicate Logic Based Image Grammars for Complex Pattern Recognition
International Journal of Computer Vision
Discriminative deep belief networks for visual data classification
Pattern Recognition
A connection between score matching and denoising autoencoders
Neural Computation
Quickly generating representative samples from an rbm-derived process
Neural Computation
A better way to learn features: technical perspective
Communications of the ACM
Unsupervised learning of hierarchical representations with convolutional deep belief networks
Communications of the ACM
Temporal restricted Boltzmann machines for dependency parsing
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Composite hashing with multiple information sources
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Canadian AI'11 Proceedings of the 24th Canadian conference on Advances in artificial intelligence
Two Distributed-State Models For Generating High-Dimensional Time Series
The Journal of Machine Learning Research
Learning features for human action recognition using multilayer architectures
IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs
ACM Transactions on Asian Language Information Processing (TALIP)
Transformation equivariant Boltzmann machines
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
A hierarchical generative model of recurrent object-based attention in the visual cortex
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Stacked convolutional auto-encoders for hierarchical feature extraction
ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
Weakly supervised learning of foreground-background segmentation using masked RBMs
ICANN'11 Proceedings of the 21st international conference on Artificial neural networks - Volume Part II
Technical Section: Neural network-based symbol recognition using a few labeled samples
Computers and Graphics
Restricted deep belief networks for multi-view learning
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Higher order contractive auto-encoder
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Comparing probabilistic models for melodic sequences
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part III
A style controller for generating virtual human behaviors
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 3
Recursive Compositional Models for Vision: Description and Review of Recent Work
Journal of Mathematical Imaging and Vision
Multi-layer topology preserving mapping for K-means clustering
IDEAL'11 Proceedings of the 12th international conference on Intelligent data engineering and automated learning
How to train your avatar: a data driven approach to gesture generation
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
On the expressive power of deep architectures
ALT'11 Proceedings of the 22nd international conference on Algorithmic learning theory
Trends and advances in speech recognition
IBM Journal of Research and Development
Bilinear deep learning for image classification
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Evolution of cartesian genetic programs for development of learning neural architecture
Evolutionary Computation
Natural Language Processing (Almost) from Scratch
The Journal of Machine Learning Research
Kernel Analysis of Deep Networks
The Journal of Machine Learning Research
In All Likelihood, Deep Belief Is Not Enough
The Journal of Machine Learning Research
Detection of mine-like objects using restricted boltzmann machines
AI'10 Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence
Deep learning networks for off-line handwritten signature recognition
CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Block-based Deep Belief Networks for face recognition
International Journal of Biometrics
LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
Random search for hyper-parameter optimization
The Journal of Machine Learning Research
Learning algorithms for the classification restricted Boltzmann machine
The Journal of Machine Learning Research
Detonation Classification from Acoustic Signature with the Restricted Boltzmann Machine
Computational Intelligence
Feature learning for activity recognition in ubiquitous computing
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Supervised dictionary learning for music genre classification
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
An efficient learning procedure for deep boltzmann machines
Neural Computation
Learning a generative model of images by factoring appearance and shape
Neural Computation
Bounding the bias of contrastive divergence learning
Neural Computation
Neural Networks
The impact of images on user clicks in product search
Proceedings of the Twelfth International Workshop on Multimedia Data Mining
Learning hash codes for efficient content reuse detection
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Reverse-engineering the human auditory pathway
WCCI'12 Proceedings of the 2012 World Congress conference on Advances in Computational Intelligence
Deep unsupervised feature learning for natural language processing
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Student Research Workshop
Sleep stage classification using unsupervised feature learning
Advances in Artificial Neural Systems - Special issue on Advances in Unsupervised Learning Techniques Applied to Biosciences and Medicine
Deep neural network language models
WLM '12 Proceedings of the NAACL-HLT 2012 Workshop: Will We Ever Really Replace the N-gram Model? On the Future of Language Modeling for HLT
Discriminative ICA model with reconstruction constraint for image classification
Proceedings of the 20th ACM international conference on Multimedia
CoNet: feature generation for multi-view semi-supervised learning with partially observed views
Proceedings of the 21st ACM international conference on Information and knowledge management
Annotating images with suggestions: user study of a tagging system
ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
Complex events detection using data-driven concepts
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Fast and adaptive deep fusion learning for detecting visual objects
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Training restricted boltzmann machines with multi-tempering: harnessing parallelization
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Learning deep belief networks from non-stationary streams
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Learning two-layer contractive encodings
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part I
Hierarchical k-means algorithm for modeling visual area v2 neurons
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
A system for offline character recognition using auto-encoder networks
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part IV
Using hybrid neural networks for identifying the brain abnormalities from MRI structural images
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V
A novel machine learning approach for detecting the brain abnormalities from MRI structural images
PRIB'12 Proceedings of the 7th IAPR international conference on Pattern Recognition in Bioinformatics
Graph regularized ICA for over-complete feature learning
CVM'12 Proceedings of the First international conference on Computational Visual Media
Energy-based temporal neural networks for imputing missing values
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
Toward designing intelligent PDEs for computer vision: An optimal control approach
Image and Vision Computing
An abstract deep network for image classification
AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
A system for classification of time-series data from industrial non-destructive device
Engineering Applications of Artificial Intelligence
Estimation based on RBM from label proportions in large group case
IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Evolving artificial neural networks for nonlinear feature construction
Proceedings of the 15th annual conference on Genetic and evolutionary computation
Dual local consistency hashing with discriminative projections selection
Signal Processing
Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Learning hierarchical bag of words using naive bayes clustering
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Multi-Level structured image coding on high-dimensional image representation
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Hierarchical space tiling for scene modeling
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Semantic hashing using tags and topic modeling
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Early experiments with neural diversity machines
Neurocomputing
Multi-source deep learning for information trustworthiness estimation
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
ClimbAX: skill assessment for climbing enthusiasts
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Building holistic descriptors for scene recognition: a multi-objective genetic programming approach
Proceedings of the 21st ACM international conference on Multimedia
Online multimodal deep similarity learning with application to image retrieval
Proceedings of the 21st ACM international conference on Multimedia
Latent feature learning in social media network
Proceedings of the 21st ACM international conference on Multimedia
Sparse activity and sparse connectivity in supervised learning
The Journal of Machine Learning Research
Regularized bundle methods for convex and non-convex risks
The Journal of Machine Learning Research
Convolutional Deep Networks for Visual Data Classification
Neural Processing Letters
Spike-timing-dependent construction
Neural Computation
AusDM '12 Proceedings of the Tenth Australasian Data Mining Conference - Volume 134
Word classification for sentiment polarity estimation using neural network
HCI International'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction design - Volume Part I
The learning problem of multi-layer neural networks
Neural Networks
Where wall-following works: case study of simple heuristics vs. optimal exploratory behaviour
Living Machines'13 Proceedings of the Second international conference on Biomimetic and Biohybrid Systems
Statistical relational data integration for information extraction
RW'13 Proceedings of the 9th international conference on Reasoning Web: semantic technologies for intelligent data access
Deep learning of representations: looking forward
SLSP'13 Proceedings of the First international conference on Statistical Language and Speech Processing
Training restricted Boltzmann machines: An introduction
Pattern Recognition
ACM Transactions on Reconfigurable Technology and Systems (TRETS)
Automatic touching detection and recognition of music chord using auto-encoding and softmax
Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication
Review article: Computational intelligence techniques in bioinformatics
Computational Biology and Chemistry
Learning ensemble classifiers via restricted Boltzmann machines
Pattern Recognition Letters
Hierarchical spatiotemporal feature extraction using recurrent online clustering
Pattern Recognition Letters
Construction of approximation spaces for reinforcement learning
The Journal of Machine Learning Research
Training energy-based models for time-series imputation
The Journal of Machine Learning Research
From machine learning to machine reasoning
Machine Learning
Expert Systems with Applications: An International Journal
Feature learning and deep architectures: new directions for music informatics
Journal of Intelligent Information Systems
A tour of machine learning: An AI perspective
AI Communications - ECAI 2012 Turing and Anniversary Track
Optical Memory and Neural Networks
Computational Intelligence and Neuroscience
Hi-index | 0.03 |
We show how to use "complementary priors" to eliminate the explaining-away effects that make inference difficult in densely connected belief nets that have many hidden layers. Using complementary priors, we derive a fast, greedy algorithm that can learn deep, directed belief networks one layer at a time, provided the top two layers form an undirected associative memory. The fast, greedy algorithm is used to initialize a slower learning procedure that fine-tunes the weights using a contrastive version of the wake-sleep algorithm. After fine-tuning, a network with three hidden layers forms a very good generative model of the joint distribution of handwritten digit images and their labels. This generative model gives better digit classification than the best discriminative learning algorithms. The low-dimensional manifolds on which the digits lie are modeled by long ravines in the free-energy landscape of the top-level associative memory, and it is easy to explore these ravines by using the directed connections to display what the associative memory has in mind.