Message quantization in belief propagation: structural results in the low-rate regime

  • Authors:
  • O. Patrick Kreidl;Alan S. Willsky

  • Affiliations:
  • Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA;Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA

  • Venue:
  • Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by distributed inference applications in unreliable communication networks, we adapt the popular (sum-product) belief propagation (BP) algorithm under the constraint of discrete-valued messages. We show that, in contrast to conventional BP, the optimal message-generation rules are node-dependent and iteration-dependent, each rule making explicit use of local memory from all past iterations. These results expose both the intractability of optimal design and an inherent structure that can be exploited for tractable approximate design. We propose one such approximation and demonstrate its efficacy on canonical examples. We also discuss extensions to communication networks with lossy links (e.g., erasures) or topologiesthat differ from the graph underlying the probabilistic model.