Title :
On match lengths and the asymptotic behavior of Sliding Window Lempel-Ziv algorithm for zero entropy sequences
Author :
Jain, Sonal ; Bansal, Rakesh K.
Author_Institution :
Dept. of Electr. Eng., Indian Inst. of Technol. Kanpur, Kanpur, India
Abstract :
The Sliding Window Lempel-Ziv (SWLZ) algorithm has been studied from various perspectives in information theory literature. In this paper, we provide a general law which defines the asymptotics of match length for stationary and ergodic zero entropy processes. Moreover, we use this law to choose the match length Lo in the almost sure optimality proof of Fixed Shift Variant of Lempel-Ziv (FSLZ) and SWLZ algorithms given in literature. First, through an example of stationary and ergodic processes generated by irrational rotation we establish that for a window size of nw a compression ratio given by O(log nw/nwa) where a is arbitrarily close to 1 and 0 <; a <; 1, is obtained under the application of FSLZ and SWLZ algorithms. Further, we give a general expression for the compression ratio for a class of stationary and totally ergodic processes with zero entropy.
Keywords :
entropy; string matching; FSLZ algorithms; SWLZ algorithms; asymptotic behavior; asymptotics; compression ratio; ergodic processes; ergodic zero entropy processes; fixed shift variant of Lempel-Ziv; information theory literature; irrational rotation; optimality proof; sliding window Lempel-Ziv algorithm; stationary entropy processes; stationary processes; zero entropy sequences; Algorithm design and analysis; Convergence; Encoding; Entropy; Genetic expression; Jacobian matrices;
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
DOI :
10.1109/ISIT.2013.6620753