• DocumentCode
    3237984
  • Title

    A locally encodable and decodable compressed data structure

  • Author

    Chandar, Venkat ; Shah, Devavrat ; Wornell, Gregory W.

  • Author_Institution
    Dept. EECS, MIT, Cambridge, MA, USA
  • fYear
    2009
  • fDate
    Sept. 30 2009-Oct. 2 2009
  • Firstpage
    613
  • Lastpage
    619
  • Abstract
    In a variety of applications, ranging from highspeed networks to massive databases, there is a need to maintain histograms and other statistics in a streaming manner. Motivated by such applications, we establish the existence of efficient source codes that are both locally encodable and locally decodable. Our solution is an explicit construction in the form of a (randomized) data structure for storing N integers. The construction uses multi-layered sparse graph codes based on Ramanujan graphs, and has the following properties: (a) the structure utilizes minimal possible space, and (b) the value of any of the integers can be read or updated in near constant time (on average and with high probability). By contrast, data structures proposed in the context of streaming algorithms and compressed sensing in recent years (e.g., various sketches) support local encodability, but not local decodability; and those known as succinct data structures are locally decodable, but not locally encodable.
  • Keywords
    data compression; data structures; graph theory; Ramanujan graph; compressed data structure; multilayered sparse graph codes; streaming algorithm; Compressed sensing; Data structures; Databases; Decoding; Histograms; Linear code; Signal design; Signal processing; Signal processing algorithms; Statistics;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing, 2009. Allerton 2009. 47th Annual Allerton Conference on
  • Conference_Location
    Monticello, IL
  • Print_ISBN
    978-1-4244-5870-7
  • Type

    conf

  • DOI
    10.1109/ALLERTON.2009.5394919
  • Filename
    5394919