• DocumentCode
    2801502
  • Title

    Heterogeneity-Aware Erasure Codes for Peer-to-Peer Storage Systems

  • Author

    Pamies-Juarez, Lluis ; García-López, Pedro ; Sánchez-Artigas, Marc

  • Author_Institution
    Dept. of Comput. Eng. & Math., Univ. Rovira i Virgili, Tarragona, Spain
  • fYear
    2009
  • fDate
    22-25 Sept. 2009
  • Firstpage
    412
  • Lastpage
    419
  • Abstract
    Peer-to-peer (P2P) storage systems rely on data redundancy to obtain high levels of data availability. Among the existing data redundancy schemes, erasure coding is a widely adopted scheme in existing P2P storage systems. By properly tunning its parameters, erasure codes can minimize the required data redundancy, which reduces both the storage and the network overheads. However, to perform this optimization, storage systems need to measured the obtained data availability. Existing P2P storage systems assume homogeneous node availabilities in order to simplify this measurement. As we will prove, this assumption entails efficiency losses when real node availabilities are highly heterogeneous. In this work, we analyze how erasure codes can be optimized in an availability-aware fashion. We propose an analytical framework able to measure data availability more precisely than existing works. As a result, we can optimize the erasure code deployment while reducing its associated overheads. Our experiments show how by considering real node availabilities it is possible to reduce data redundancy about 50% and up to 80% in some specific scenarios.
  • Keywords
    codes; peer-to-peer computing; data availability; data redundancy schemes; heterogeneity-aware erasure codes; peer-to-peer storage systems; Analytical models; Availability; Concurrent computing; Costs; Data engineering; Mathematics; Parallel processing; Peer to peer computing; Performance evaluation; Telecommunication traffic; availability; backup; erasure codes; peer-to-peer; storage;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Parallel Processing, 2009. ICPP '09. International Conference on
  • Conference_Location
    Vienna
  • ISSN
    0190-3918
  • Print_ISBN
    978-1-4244-4961-3
  • Electronic_ISBN
    0190-3918
  • Type

    conf

  • DOI
    10.1109/ICPP.2009.15
  • Filename
    5362424