Data Parallel Implementation of Belief Propagation in Factor Graphs on Multi-core Platforms

  • Authors:
  • Nam Ma;Yinglong Xia;Viktor K. Prasanna

  • Affiliations:
  • Department of Computer Science, University of Southern California, Los Angeles, USA 90089;IBM T.J. Watson Research Center, Yorktown Heights, USA 10598;Ming Hsieh Department of Electrical Engineering, University of Southern California, Los Angeles, USA 90089

  • Venue:
  • International Journal of Parallel Programming
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate data parallel techniques for belief propagation in acyclic factor graphs on multi-core systems. Belief propagation is a key inference algorithm in factor graph, a probabilistic graphical model that has found applications in many domains. In this paper, we explore data parallelism for basic operations over the potential tables in belief propagation. Data parallel techniques for these table operations are developed for shared memory platforms. We then propose a complete belief propagation algorithm using these table operations to perform exact inference in factor graphs. The proposed algorithms are implemented on state-of-the-art multi-socket multi-core systems with additional NUMA-aware optimizations. Our proposed algorithms exhibit good scalability using a representative set of factor graphs. On a four-socket Intel Westmere-EX system with 40 cores, we achieve 39.5 $$\times $$ 脳 speedup for the table operations and 39 $$\times $$ 脳 speedup for the complete algorithm using factor graphs with large potential tables.