• DocumentCode
    2944631
  • Title

    Quasi-cyclic Minimum Storage Regenerating Codes for Distributed Data Compression

  • Author

    Gastón, Bernat ; Pujol, Jaume ; Villanueva, Mercè

  • Author_Institution
    Dept. of Inf. & Commun. Eng., Autonomous Univ. of Barcelona, Cerdanyola del Valles, Spain
  • fYear
    2011
  • fDate
    29-31 March 2011
  • Firstpage
    33
  • Lastpage
    42
  • Abstract
    Nowadays, it is possible to optimize the storage size of large files in distributed environments, maintaining the same availability level in the system. Although replication (backups) is the most used option, it is possible to make use of erasure coding in order to significantly compress the storage size [1]. However, using erasure coding, more information needs to be transmitted than when using replication, in order to replace a node which has failed. This is called the code repair problem. The amount of transmitted information can be an important issue when the file size is very large. If network coding is used in conjunction with erasure codes, the transmitted information can be reduced by compressing the sent data in the regeneration phase. This solution minimizes the code repair problem and consists of the use of regenerating codes introduced by Dimakis et al. [2]. Nevertheless, using network coding, computational resources for any node in the system are required, since linear operations must be carried out and systems of equations must be solved in the nodes. This requirement is too strong for many simple storage devices [3]. In this paper a new family of Minimum Storage Regenerating codes is proposed. These codes not only compress the storage size using erasure coding and achieve optimality for the amount of transmitted information when d = k + 1, but also demand few computational requirements. Therefore, they could be used for simple hard discs without computational resources.
  • Keywords
    computational complexity; cyclic codes; data compression; distributed databases; fault tolerance; forward error correction; optimisation; code repair problem; distributed data compression; erasure coding; quasi-cyclic minimum storage regenerating code; Bandwidth; Distributed databases; Encoding; Equations; Maintenance engineering; Network coding; Redundancy; Regenerating codes; distributed data compression; distributed storage; error-correcting;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Compression Conference (DCC), 2011
  • Conference_Location
    Snowbird, UT
  • ISSN
    1068-0314
  • Print_ISBN
    978-1-61284-279-0
  • Type

    conf

  • DOI
    10.1109/DCC.2011.11
  • Filename
    5749461