Title :
Efficient index lookup for De-duplication backup system
Author :
Won, Youjip ; Ban, Jongmyeong ; Min, Jaehong ; Hur, Jungpil ; Oh, Sangkyu ; Lee, Jangsun
Author_Institution :
Dept. of Electron. & Comput. Eng., Hanyang Univ., Seoul
Abstract :
We minimizes fingerprint management overhead (index lookup and index insert) via introducing main memory index lookup structure and workload-aware index partitioning of the index file in the storage. Backup server maintains three data structures for redundancy elimination: Header files, chunk files and fingerprint tables. These data structures altogether enables PRUNE to effectively eliminate redundancy and to perform efficient backup. We perform various experiment to measure the overhead of each tasks in backup operation and to examine the efficiency of redundancy elimination. Incremental modulo-K reduces the file chunking latency by approximately 60%. With filter based in-memory index data structure and index partitioning, PRUNE eliminates 99.4% of disk accesses involved in fingerprint management.
Keywords :
data structures; data structures; deduplication backup system; file chunking latency; fingerprint management overhead; memory index lookup structure; workload-aware index partitioning; Data structures; Engineering management; File servers; File systems; Filters; Fingerprint recognition; Maintenance engineering; Memory management; Performance evaluation; Storage area networks;
Conference_Titel :
Modeling, Analysis and Simulation of Computers and Telecommunication Systems, 2008. MASCOTS 2008. IEEE International Symposium on
Conference_Location :
Baltimore, MD
Print_ISBN :
978-1-4244-2817-5
Electronic_ISBN :
1526-7539
DOI :
10.1109/MASCOT.2008.4770594