Title :
Availability and locality in distributed storage
Author :
Rawat, A.S. ; Papailiopoulos, Dimitris S. ; Dimakis, Alexandros G.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Texas at Austin, Austin, TX, USA
Abstract :
Modern distributed file systems are deploying erasure codes to increase storage efficiency compared to block replication. Initially, classical error-correcting codes (like Reed-Solomon) were used but the benefits of custom code designs are now clear. Multiple companies including Microsoft and Facebook are designing and deploying distributed storage codes. Still, however, the fundamental information theoretic limits are not fully understood. Further, there has been significant activity on explicit code designs that are repair efficient and provide high data-availability. We present an overview of open problems and directions for modern distributed storage coding that offers higher data availability.
Keywords :
distributed databases; error correction codes; network operating systems; Facebook; Microsoft; block replication; custom code designs; data availability; distributed file systems; distributed storage coding; erasure codes; error-correcting codes; explicit code designs; storage efficiency; Availability; Encoding; Maintenance engineering; Measurement; Reed-Solomon codes; Systematics;
Conference_Titel :
Global Conference on Signal and Information Processing (GlobalSIP), 2013 IEEE
Conference_Location :
Austin, TX
DOI :
10.1109/GlobalSIP.2013.6737043