• DocumentCode
    3077546
  • Title

    General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System

  • Author

    Qing Liu ; Dan Feng ; Zhan Shi ; Min Fu

  • Author_Institution
    Wuhan Nat. Lab. for Optoelectron., HUST, China
  • fYear
    2015
  • fDate
    4-7 May 2015
  • Firstpage
    372
  • Lastpage
    381
  • Abstract
    Erasure codes are widely used in modern distributed storage systems to prevent data loss and server failures. Regenerating codes are a class of erasure codes that trades storage efficiency and computation for repair bandwidth reduction. However, their non-unified coding parameters and huge computation overhead prohibit their applications. Hence, we first propose a family of Functional Regenerating Codes (FRCs) with uncoded repair, balancing storage efficiency and repair bandwidth with general parameters. FRCs take advantage of a heuristic repair algorithm, which makes efforts to employ as little repair bandwidth as possible. Second, we optimize encoding by constructing the generator matrix with a bitmatrix, so encoding of FRCs can be executed by fast bitwise XORs. Further, we also optimize repairing with the Scheduled Shift Multiplication (SSM) algorithm, which accelerates the matrix product over the Galois field during repair. Compared to the traditional table-lookup multiplication algorithm, our SSM algorithm gains 1.2~2X speed-up.
  • Keywords
    Galois fields; error correction codes; matrix multiplication; storage management; FRCs; Galois field; SSM algorithm; balancing storage efficiency; bitmatrix; data loss; distributed storage system; erasure codes; fast bitwise XORs; general functional regenerating codes; generator matrix; heuristic repair algorithm; matrix product; nonunified coding parameters; repair bandwidth reduction; scheduled shift multiplication algorithm; server failures; table-lookup multiplication algorithm; uncoded repair; Bandwidth; Distributed databases; Encoding; Generators; Intellectual property; Maintenance engineering; Robustness; Performance and evaluation; Regenerating codes; Repair bandwidth; Storage system; Uncoded repair;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Cluster, Cloud and Grid Computing (CCGrid), 2015 15th IEEE/ACM International Symposium on
  • Conference_Location
    Shenzhen
  • Type

    conf

  • DOI
    10.1109/CCGrid.2015.38
  • Filename
    7152503