DocumentCode :
2559194
Title :
Efficient index lookup for De-duplication backup system
Author :
Won, Youjip ; Ban, Jongmyeong ; Min, Jaehong ; Hur, Jungpil ; Oh, Sangkyu ; Lee, Jangsun
Author_Institution :
Dept. of Electron. & Comput. Eng., Hanyang Univ., Seoul
fYear :
2008
fDate :
8-10 Sept. 2008
Firstpage :
1
Lastpage :
3
Abstract :
We minimizes fingerprint management overhead (index lookup and index insert) via introducing main memory index lookup structure and workload-aware index partitioning of the index file in the storage. Backup server maintains three data structures for redundancy elimination: Header files, chunk files and fingerprint tables. These data structures altogether enables PRUNE to effectively eliminate redundancy and to perform efficient backup. We perform various experiment to measure the overhead of each tasks in backup operation and to examine the efficiency of redundancy elimination. Incremental modulo-K reduces the file chunking latency by approximately 60%. With filter based in-memory index data structure and index partitioning, PRUNE eliminates 99.4% of disk accesses involved in fingerprint management.
Keywords :
data structures; data structures; deduplication backup system; file chunking latency; fingerprint management overhead; memory index lookup structure; workload-aware index partitioning; Data structures; Engineering management; File servers; File systems; Filters; Fingerprint recognition; Maintenance engineering; Memory management; Performance evaluation; Storage area networks;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Modeling, Analysis and Simulation of Computers and Telecommunication Systems, 2008. MASCOTS 2008. IEEE International Symposium on
Conference_Location :
Baltimore, MD
ISSN :
1526-7539
Print_ISBN :
978-1-4244-2817-5
Electronic_ISBN :
1526-7539
Type :
conf
DOI :
10.1109/MASCOT.2008.4770594
Filename :
4770594
Link To Document :
بازگشت