Improving distributed join efficiency with extended bloom filter operations

  • Authors:
  • Loizos Michael;Wolfgang Nejdl;Odysseas Papapetrou;Wolf Siberski

  • Affiliations:
  • Harvard University;Leibniz Universitat Hannover;Leibniz Universitat Hannover;Leibniz Universitat Hannover

  • Venue:
  • AINA '07 Proceedings of the 21st International Conference on Advanced Networking and Applications
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Bloom filter based algorithms have proven successful as very efficient technique to reduce communication costs of database joins in a distributed setting. However, the full potential of bloom filters has not yet been exploited. Especially in the case of multi-joins, where the data is distributed among several sites, additional optimization opportunities arise, which require new bloom filter operations and computations. In this paper, we present these extensions and point out how they improve the performance of such distributed joins. While the paper focuses on efficient join computation, the described extensions are applicable to a wide range of usages, where bloom filters are facilitated for compressed set representation.