DocumentCode
2944631
Title
Quasi-cyclic Minimum Storage Regenerating Codes for Distributed Data Compression
Author
Gastón, Bernat ; Pujol, Jaume ; Villanueva, Mercè
Author_Institution
Dept. of Inf. & Commun. Eng., Autonomous Univ. of Barcelona, Cerdanyola del Valles, Spain
fYear
2011
fDate
29-31 March 2011
Firstpage
33
Lastpage
42
Abstract
Nowadays, it is possible to optimize the storage size of large files in distributed environments, maintaining the same availability level in the system. Although replication (backups) is the most used option, it is possible to make use of erasure coding in order to significantly compress the storage size [1]. However, using erasure coding, more information needs to be transmitted than when using replication, in order to replace a node which has failed. This is called the code repair problem. The amount of transmitted information can be an important issue when the file size is very large. If network coding is used in conjunction with erasure codes, the transmitted information can be reduced by compressing the sent data in the regeneration phase. This solution minimizes the code repair problem and consists of the use of regenerating codes introduced by Dimakis et al. [2]. Nevertheless, using network coding, computational resources for any node in the system are required, since linear operations must be carried out and systems of equations must be solved in the nodes. This requirement is too strong for many simple storage devices [3]. In this paper a new family of Minimum Storage Regenerating codes is proposed. These codes not only compress the storage size using erasure coding and achieve optimality for the amount of transmitted information when d = k + 1, but also demand few computational requirements. Therefore, they could be used for simple hard discs without computational resources.
Keywords
computational complexity; cyclic codes; data compression; distributed databases; fault tolerance; forward error correction; optimisation; code repair problem; distributed data compression; erasure coding; quasi-cyclic minimum storage regenerating code; Bandwidth; Distributed databases; Encoding; Equations; Maintenance engineering; Network coding; Redundancy; Regenerating codes; distributed data compression; distributed storage; error-correcting;
fLanguage
English
Publisher
ieee
Conference_Titel
Data Compression Conference (DCC), 2011
Conference_Location
Snowbird, UT
ISSN
1068-0314
Print_ISBN
978-1-61284-279-0
Type
conf
DOI
10.1109/DCC.2011.11
Filename
5749461
Link To Document