DocumentCode
3237984
Title
A locally encodable and decodable compressed data structure
Author
Chandar, Venkat ; Shah, Devavrat ; Wornell, Gregory W.
Author_Institution
Dept. EECS, MIT, Cambridge, MA, USA
fYear
2009
fDate
Sept. 30 2009-Oct. 2 2009
Firstpage
613
Lastpage
619
Abstract
In a variety of applications, ranging from highspeed networks to massive databases, there is a need to maintain histograms and other statistics in a streaming manner. Motivated by such applications, we establish the existence of efficient source codes that are both locally encodable and locally decodable. Our solution is an explicit construction in the form of a (randomized) data structure for storing N integers. The construction uses multi-layered sparse graph codes based on Ramanujan graphs, and has the following properties: (a) the structure utilizes minimal possible space, and (b) the value of any of the integers can be read or updated in near constant time (on average and with high probability). By contrast, data structures proposed in the context of streaming algorithms and compressed sensing in recent years (e.g., various sketches) support local encodability, but not local decodability; and those known as succinct data structures are locally decodable, but not locally encodable.
Keywords
data compression; data structures; graph theory; Ramanujan graph; compressed data structure; multilayered sparse graph codes; streaming algorithm; Compressed sensing; Data structures; Databases; Decoding; Histograms; Linear code; Signal design; Signal processing; Signal processing algorithms; Statistics;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing, 2009. Allerton 2009. 47th Annual Allerton Conference on
Conference_Location
Monticello, IL
Print_ISBN
978-1-4244-5870-7
Type
conf
DOI
10.1109/ALLERTON.2009.5394919
Filename
5394919
Link To Document