• DocumentCode
    2480878
  • Title

    Pre-calculated equation-based decoding in failure-tolerant distributed storage

  • Author

    Sobe, Peter

  • Author_Institution
    Inst. of Comput. Eng., Univ. of Luebeck, Lubeck, Germany
  • fYear
    2009
  • fDate
    23-29 May 2009
  • Firstpage
    1
  • Lastpage
    8
  • Abstract
    Data distribution together with erasure-tolerant codes allow to store data reliably, even with failed or temporarily disconnected storage resources. The encoding algorithm, i.e. the calculation of the codewords is expressed by XOR equations. Even decoding is the execution of a failure-specific set of equations that are build code-specifically and with knowledge of the failure situation. A new concept for a storage system is to provide encoding equations and decoding equations in advance, as a full description of the code which eliminates the calculations to obtain the recovery strategy. This concept includes that also decoding equations have to be provided in advance, for many different failure situations. This results in a large number of equations and may require a considerable amount of memory, but still a moderate amount - which can be traded for the gained flexibility and simplicity. In this paper we analyze the storage consumption of such a preprocessed decoding equation set. Furthermore, a data structure to access the required equations is proposed. It is shown that codes can be translated into equation sets that are used as parameter set by a storage system.
  • Keywords
    data structures; decoding; encoding; fault tolerance; storage management; XOR equations; data distribution; decoding equations; encoding equations; erasure-tolerant codes; failure-tolerant distributed storage; pre-calculated equation-based decoding; Data engineering; Data structures; Differential equations; Distributed computing; Encoding; Iterative decoding; Redundancy; Reliability engineering; Solid state circuits;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Parallel & Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on
  • Conference_Location
    Rome
  • ISSN
    1530-2075
  • Print_ISBN
    978-1-4244-3751-1
  • Electronic_ISBN
    1530-2075
  • Type

    conf

  • DOI
    10.1109/IPDPS.2009.5160904
  • Filename
    5160904