A revolution: belief propagation in graphs with cycles
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
A Bayesian approach to on-line learning
On-line learning in neural networks
A linear approximation method for probabilistic inference
UAI '88 Proceedings of the Fourth Annual Conference on Uncertainty in Artificial Intelligence
A family of algorithms for approximate bayesian inference
A family of algorithms for approximate bayesian inference
Gaussian Processes for Classification: Mean-Field Algorithms
Neural Computation
A general algorithm for approximate inference and its application to hybrid bayes nets
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Loopy belief propagation for approximate inference: an empirical study
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Tractable inference for complex stochastic processes
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Factor graphs and the sum-product algorithm
IEEE Transactions on Information Theory
Sparse on-line Gaussian processes
Neural Computation
The Journal of Machine Learning Research
New sequential Monte Carlo methods for nonlinear dynamic systems
Statistics and Computing
Robust Gaussian Process Regression with a Student-t Likelihood
The Journal of Machine Learning Research
U-likelihood and U-updating algorithms: statistical inference in latent variable models
ECML'05 Proceedings of the 16th European conference on Machine Learning
Mixture of gaussian processes for combining multiple modalities
MCS'05 Proceedings of the 6th international conference on Multiple Classifier Systems
Forecasting foreign exchange rates using kernel methods
Expert Systems with Applications: An International Journal
A case study on meta-generalising: a Gaussian processes approach
The Journal of Machine Learning Research
Active graph reachability reduction for network security and software engineering
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
glm-ie: generalised linear models inference & estimation toolbox
The Journal of Machine Learning Research
Entropy search for information-efficient global optimization
The Journal of Machine Learning Research
Designing Model Based Classifiers by Emphasizing Soft Targets
Fundamenta Informaticae - Advances in Artificial Intelligence and Applications
Collaborative learning of preference rankings
Proceedings of the sixth ACM conference on Recommender systems
Training factored PCFGs with expectation propagation
EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Score-Based bayesian skill learning
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Collective inference for network data with copula latent markov networks
Proceedings of the sixth ACM international conference on Web search and data mining
Posterior consistency in conditional distribution estimation
Journal of Multivariate Analysis
Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Nested expectation propagation for Gaussian process classification
The Journal of Machine Learning Research
Variational inference in nonconjugate models
The Journal of Machine Learning Research
Learning community-based preferences via dirichlet process mixtures of Gaussian processes
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Lifelong learning for acquiring the wisdom of the crowd
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Infinite Dirichlet mixture models learning via expectation propagation
Advances in Data Analysis and Classification
Journal of Computational Physics
Gaussian Kullback-Leibler approximate inference
The Journal of Machine Learning Research
Perturbative corrections for approximate inference in Gaussian latent variable models
The Journal of Machine Learning Research
Decomposition and Approximation of Loopy Bayesian Networks
Fundamenta Informaticae
Predictive Distribution of the Dirichlet Mixture Model by Local Variational Inference
Journal of Signal Processing Systems
Hi-index | 0.01 |
This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation," unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief propagation, an extension of belief propagation in Bayesian networks. Loopy belief propagation, because it propagates exact belief states, is useful for a limited class of belief networks, such as those which are purely discrete. Expectation Propagation approximates the belief states by only retaining expectations, such as mean and varitmce, and iterates until these expectations are consistent throughout the network. This makes it applicable to hybrid networks with discrete and continuous nodes. Experiments with Gaussian mixture models show Expectation Propagation to be donvincingly better than methods with similar computational cost: Laplace's method, variational Bayes, and Monte Carlo. Expectation Propagation also provides an efficient algorithm for training Bayes point machine classifiers.