Title :
Fast Bloom Filters and Their Generalization
Author :
Yan Qiao ; Tao Li ; Shigang Chen
Author_Institution :
Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
Abstract :
Bloom filters have been extensively applied in many network functions. Their performance is judged by three criteria: query overhead, space requirement, and false positive ratio. Due to wide applicability, any improvement to the performance of Bloom filters can potentially have a broad impact in many areas of networking research. In this paper, we study Bloom-1, a data structure that performs membership check in one memory access, which compares favorably with the k memory accesses of a standard Bloom filter. We also generalize Bloom-1 to Bloom-g and Bloom-Q, allowing performance tradeoff between membership query overhead and false positive ratio. We thoroughly examine the variants in this family of filters, and show that they can be configured to outperform the Bloom filters with a smaller number of memory accesses, a smaller or equal number of hash bits, and a smaller or comparable false positive ratio in practical scenarios. We also perform experiments based on a real traffic trace to support our filter design.
Keywords :
data structures; Bloom-1 data structure; Bloom-Q; Bloom-g; false positive ratio; fast Bloom filters; filter design; generalization; membership check; memory access; network functions; networking research; query overhead; space requirement; traffic trace; Arrays; Hardware; Information filtering; Memory management; Random access memory; Throughput; Bloom filter; false positive; hash requirement; memory access;
Journal_Title :
Parallel and Distributed Systems, IEEE Transactions on
DOI :
10.1109/TPDS.2013.46