Title :
Enhancing Counting Bloom Filters Through Huffman-Coded Multilayer Structures
Author :
Ficara, Domenico ; Di Pietro, Andrea ; Giordano, Stefano ; Procissi, Gregorio ; Vitucci, Fabio
Author_Institution :
Dipt. di Ing. dell´´Inf., Univ. di Pisa, Pisa, Italy
Abstract :
Bloom Filters are efficient randomized data structures for membership queries on a set with a certain known false positive probability. Counting Bloom Filters (CBFs) allow the same operation on dynamic sets that can be updated via insertions and deletions with larger memory requirements. This paper first presents a simple tight upper bound for counters overflow probability in CBFs, which is adopted in the design of more efficient CBFs. On the basis of such theoretical achievements, we introduce the idea of a hierarchical structure as well as the use of Huffman code to improve standard CBFs in terms of fast access and limited memory consumption (up to 50% of memory saving). The target could be the implementation of the compressed data structures in the small (but fast) local memory or “on-chip SRAM” of devices such as network processors. As an application of our algorithms, an anti-evasion system is finally proposed.
Keywords :
Huffman codes; SRAM chips; Huffman code; Huffman-coded multilayer structure; compressed data structure; counting bloom filter; dynamic set; false positive probability; limited memory consumption; memory requirement; memory saving; network processor; on-chip SRAM; overflow probability; randomized data structure; Application software; Code standards; Complexity theory; Computer applications; Counting circuits; Data processing; Data structures; Filters; Huffman coding; Memory management; Nonhomogeneous media; Radiation detectors; Random access memory; Upper bound; Counting Bloom Filter (CBF); Huffman coding; evasion; hashing; multilayer structure; network processor;
Journal_Title :
Networking, IEEE/ACM Transactions on
DOI :
10.1109/TNET.2010.2055243