Title :
Using synchronization bits to boost compression by substring enumeration
Author_Institution :
Univ. Laval, Quebec City, QC, Canada
Abstract :
A new lossless data compression technique called compression via substring enumeration (CSE) has recently been introduced. It has been observed that CSE achieves lower performance on binary data. An hypothesis has been formulated that suggests that CSE loses track of the position of the bits relative to the byte boundaries more easily in binary data and that this confusion incurs a penalty for CSE. This paper questions the validity of the hypothesis and proposes a simple technique to reduce the penalty, in case the hypothesis is correct. The technique consists in adding a preprocessing step that inserts synchronization bits in the data in order to boost the performance of CSE. Experiments provide strong evidence that the formulated hypothesis is true and they demonstrate the effectiveness of the use of synchronization bits.
Keywords :
data compression; synchronisation; binary data; byte boundaries; compression by substring enumeration; lossless data compression technique; preprocessing step; synchronization bits; Benchmark testing; Data compression; Data structures; Lead; Phase measurement; Synchronization; Transforms;
Conference_Titel :
Information Theory and its Applications (ISITA), 2010 International Symposium on
Conference_Location :
Taichung
Print_ISBN :
978-1-4244-6016-8
Electronic_ISBN :
978-1-4244-6017-5
DOI :
10.1109/ISITA.2010.5649565