Analysis of low density codes and improved designs using irregular graphs
STOC '98 Proceedings of the thirtieth annual ACM symposium on Theory of computing
Solving crossword puzzles as probabilistic constraint satisfaction
AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Improved classification via connectivity information
SODA '00 Proceedings of the eleventh annual ACM-SIAM symposium on Discrete algorithms
An Introduction to Variational Methods for Graphical Models
Machine Learning
International Journal of Computer Vision - Special issue on statistical and computational theories of vision: modeling, learning, sampling and computing, Part I
A probabilistic approach to solving crossword puzzles
Artificial Intelligence - Chips challenging champions: games, computers and Artificial Intelligence
Mini-buckets: A general scheme for bounded inference
Journal of the ACM (JACM)
Approximate inference in Boltzmann machines
Artificial Intelligence
A Double-Loop Algorithm to Minimize the Bethe Free Energy
EMMCVPR '01 Proceedings of the Third International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition
Tree approximation for belief updating
Eighteenth national conference on Artificial intelligence
Understanding belief propagation and its generalizations
Exploring artificial intelligence in the new millennium
Implementation of Near Shannon Limit Error-Correcting Codes Using Reconfigurable Hardware
FCCM '00 Proceedings of the 2000 IEEE Symposium on Field-Programmable Custom Computing Machines
Learning to cluster using local neighborhood structure
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Decoding turbo-like codes via linear programming
Journal of Computer and System Sciences - Special issue on FOCS 2002
Probabilistic fault localization in communication systems using belief networks
IEEE/ACM Transactions on Networking (TON)
On the uniqueness of loopy belief propagation fixed points
Neural Computation
Estimation and Marginalization Using the Kikuchi Approximation Methods
Neural Computation
Correctness of Local Probability Propagation in Graphical Models with Loops
Neural Computation
On the interdependence of sensing and estimation complexity in sensor networks
Proceedings of the 5th international conference on Information processing in sensor networks
Journal of VLSI Signal Processing Systems
A parallel framework for loopy belief propagation
Proceedings of the 9th annual conference companion on Genetic and evolutionary computation
Iterative decoding of concatenated codes: a tutorial
EURASIP Journal on Applied Signal Processing
Joint source-channel decoding of variable-length codes with soft information: a survey
EURASIP Journal on Applied Signal Processing
Event detection using "variable module graphs" for home care applications
EURASIP Journal on Applied Signal Processing
Calibrating distributed camera networks using belief propagation
EURASIP Journal on Applied Signal Processing
Comparison of LDPC decoding algorithms with and without estimation of noise variance
Mobility '06 Proceedings of the 3rd international conference on Mobile technology, applications & systems
Approximate algorithms for credal networks with binary variables
International Journal of Approximate Reasoning
The Journal of Machine Learning Research
Cost-sensitive learning with conditional Markov networks
Data Mining and Knowledge Discovery
CiE '07 Proceedings of the 3rd conference on Computability in Europe: Computation and Logic in the Real World
Inference in the Promedas Medical Expert System
AIME '07 Proceedings of the 11th conference on Artificial Intelligence in Medicine
Efficient decoding of turbo codes with nonbinary belief propagation
EURASIP Journal on Wireless Communications and Networking - Advances in Error Control Coding Techniques
Automatic Mutual Nonrigid Registration of Dense Surfaces by Graphical Model Based Inference
SSPR & SPR '08 Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition
Graphical Models, Exponential Families, and Variational Inference
Foundations and Trends® in Machine Learning
Accuracy of Loopy belief propagation in Gaussian models
Neural Networks
Mixed deterministic and probabilistic networks
Annals of Mathematics and Artificial Intelligence
Focusing generalizations of belief propagation on targeted queries
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Many-pairs mutual information for adding structure to belief propagation approximations
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Convexity arguments for efficient minimization of the Bethe and Kikuchi free energies
Journal of Artificial Intelligence Research
Cutset sampling for Bayesian networks
Journal of Artificial Intelligence Research
New code construction method and high-speed VLSI codec architecture for repeat-accumulate codes
WSEAS TRANSACTIONS on COMMUNICATIONS
Good concatenated code ensembles for the binary erasure channel
IEEE Journal on Selected Areas in Communications - Special issue on capaciyy approaching codes
Fast parallel weighted bit flipping decoding algorithm for LDPC codes
WTS'09 Proceedings of the 2009 conference on Wireless Telecommunications Symposium
Belief propagation based decoding of large non-orthogonal STBCs
ISIT'09 Proceedings of the 2009 IEEE international conference on Symposium on Information Theory - Volume 3
Partial iterative decoding for binary turbo codes via cross-entropy based bit selection
IEEE Transactions on Communications
Average-case analysis for the MAX-2SAT problem
Theoretical Computer Science
Cautious Collective Classification
The Journal of Machine Learning Research
Good error correcting output codes for adaptive multiclass learning
MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
A new framework for machine learning
WCCI'08 Proceedings of the 2008 IEEE world conference on Computational intelligence: research frontiers
Message quantization in belief propagation: structural results in the low-rate regime
Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
A low density lattice decoder via non-parametric belief propagation
Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
International Journal of Sensor Networks
On the relation of MIMO APP detection and SIMO maximum ratio combining
GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Propagation connectivity of random hypergraphs
SAGA'09 Proceedings of the 5th international conference on Stochastic algorithms: foundations and applications
Understanding the scalability of Bayesian network inference using clique tree growth curves
Artificial Intelligence
IEEE Transactions on Information Theory
On the application of BP decoding to convolutional and turbo codes
Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
Performance and complexity tradeoffs of space-time modulation and coding schemes
Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
FastInf: An Efficient Approximate Inference Library
The Journal of Machine Learning Research
Join-graph propagation algorithms
Journal of Artificial Intelligence Research
Belief propagation, Dykstra's algorithm, and iterated information projections
IEEE Transactions on Information Theory
Turbo parsers: dependency parsing by approximate variational inference
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Conflict resolution and preference learning in ubiquitous environment
ICIC'06 Proceedings of the 2006 international conference on Intelligent computing: Part II
Journal of Intelligent and Robotic Systems
On the relationship between belief propagation decoding and joint maximum likelihood detection
IEEE Transactions on Communications
LDPC decoders with informed dynamic scheduling
IEEE Transactions on Communications
A hybrid factored frontier algorithm for dynamic Bayesian network models of biopathways
Proceedings of the 9th International Conference on Computational Methods in Systems Biology
Loopy belief propagation for approximate inference: an empirical study
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Hybrid processing of beliefs and constraints
UAI'01 Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence
The factored frontier algorithm for approximate inference in DBNs
UAI'01 Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence
Belief optimization for binary networks: a stable alternative to loopy belief propagation
UAI'01 Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence
Empirical evaluation of approximation algorithms for probabilistic decoding
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Error bounds between marginal probabilities and beliefs of loopy belief propagation algorithm
MICAI'06 Proceedings of the 5th Mexican international conference on Artificial Intelligence
Applications of gibbs measure theory to loopy belief propagation algorithm
MICAI'06 Proceedings of the 5th Mexican international conference on Artificial Intelligence
Loopy belief propagation as a basis for communication in sensor networks
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
A simple insight into iterative belief propagation's success
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
An importance sampling algorithm based on evidence pre-propagation
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Improving mining quality by exploiting data dependency
PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Incremental signaling pathway modeling by data integration
RECOMB'10 Proceedings of the 14th Annual international conference on Research in Computational Molecular Biology
Data association based on optimization in graphical models with application to sensor networks
Mathematical and Computer Modelling: An International Journal
Importance sampling algorithms for Bayesian networks: Principles and performance
Mathematical and Computer Modelling: An International Journal
Joint source-channel coding as an element of a QoS framework for '4G' wireless multimedia
Computer Communications
Intelligent tutoring systems: a new proposed structure
Proceedings of the International Conference on Advances in Computing, Communications and Informatics
Analysis of Markov Boundary Induction in Bayesian Networks: A New View From Matroid Theory
Fundamenta Informaticae
A Hybrid Factored Frontier Algorithm for Dynamic Bayesian Networks with a Biopathways Application
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Influence spread in large-scale social networks --- a belief propagation approach
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
Image registration using BP-SIFT
Journal of Visual Communication and Image Representation
Cross image inference scheme for stereo matching
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part IV
| Hi-index | 0.19 |
We describe the close connection between the now celebrated iterative turbo decoding algorithm of Berrou et al. (1993) and an algorithm that has been well known in the artificial intelligence community for a decade, but which is relatively unknown to information theorists: Pearl's (1982) belief propagation algorithm. We see that if Pearl's algorithm is applied to the “belief network” of a parallel concatenation of two or more codes, the turbo decoding algorithm immediately results. Unfortunately, however, this belief diagram has loops, and Pearl only proved that his algorithm works when there are no loops, so an explanation of the experimental performance of turbo decoding is still lacking. However, we also show that Pearl's algorithm can be used to routinely derive previously known iterative, but suboptimal, decoding algorithms for a number of other error-control systems, including Gallager's (1962) low-density parity-check codes, serially concatenated codes, and product codes. Thus, belief propagation provides a very attractive general methodology for devising low-complexity iterative decoding algorithms for hybrid coded systems