Enhancing counting bloom filters through Huffman-coded multilayer structures

  • Authors:
  • Domenico Ficara;Andrea Di Pietro;Stefano Giordano;Gregorio Procissi;Fabio Vitucci

  • Affiliations:
  • Dipartimento di Ingegneria dell'Informazione, Università di Pisa, Pisa, Italy;Dipartimento di Ingegneria dell'Informazione, Università di Pisa, Pisa, Italy;Dipartimento di Ingegneria dell'Informazione, Università di Pisa, Pisa, Italy;Dipartimento di Ingegneria dell'Informazione, Università di Pisa, Pisa, Italy;Dipartimento di Ingegneria dell'Informazione, Università di Pisa, Pisa, Italy

  • Venue:
  • IEEE/ACM Transactions on Networking (TON)
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Bloom Filters are efficient randomized data structures for membership queries on a set with a certain known false positive probability. Counting Bloom Filters (CBFs) allow the same operation on dynamic sets that can be updated via insertions and deletions with larger memory requirements. This paper first presents a simple tight upper bound for counters overflow probability in CBFs, which is adopted in the design of more efficient CBFs. On the basis of such theoretical achievements, we introduce the idea of a hierarchical structure as well as the use of Huffman code to improve standard CBFs in terms of fast access and limited memory consumption (up to 50% of memory saving). The target could be the implementation of the compressed data structures in the small (but fast) local memory or "on-chip SRAM" of devices such as network processors. As an application of our algorithms, an anti-evasion system is finally proposed.