Comparison of Redundancy Schemes for Distributed Storage Systems

Author

Sobe, Peter ; Peter, Kathrin

Author_Institution

Inst. of Comput. Eng., Univ. of Lubeck

fYear

2006

fDate

24-26 July 2006

Firstpage

196

Lastpage

203

Abstract

Reliable distributed data storage systems have to employ redundancy codes to tolerate the loss of storages. Many appropriate codes and algorithms can be found in the literature, but efficient schemes for tolerating several storage failures and their embedding in a distributed system are still research issues. In this paper, a variety of redundancy schemes are compared that got implemented in a distributed storage system. All schemes are based on parity and Reed/Solomon and are integrated in the storage system NetRAID. This system allows to configure several user-specified layouts. A performance and reliability analysis of several data and redundancy layouts is presented that combines analytical and experimental results. In a detail, we present performance results for an optimized Reed/Solomon implementation and give an outline for speeding up encoding and recovery by reconfigurable hardware employed in the distributed storage system

Keywords

RAID; Reed-Solomon codes; redundancy; storage management; NetRAID storage system; Reed-Solomon implementation; distributed storage system; reconfigurable hardware; redundancy schemes; reliability analysis; Data analysis; Data engineering; Data storage systems; Distributed computing; Fault tolerance; Hardware; Interleaved codes; Performance analysis; Redundancy; Reliability engineering;

fLanguage

English

Publisher

ieee

Conference_Titel

Network Computing and Applications, 2006. NCA 2006. Fifth IEEE International Symposium on

Conference_Location

Cambridge, MA

Print_ISBN

0-7695-2640-3

Type

conf

DOI

10.1109/NCA.2006.18

Filename

1659492