Title :
On the redundancy of lossy source coding
Author :
Zhang, Zhen ; Yang, En-Hui ; Wei, Victor K.
Author_Institution :
Dept. of Electr. Eng. Syst., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
The redundancy of a source code is the difference between its expected performance and the optimum performance theoretically attainable (OPTA). In an analysis of the redundancy problem of source coding the aim is to investigate the trade-off between the minimum redundancy over a class of codes having a common parameter (such as block length) and the common parameter. We assume that the common parameter associated with the codes considered is block length. We refer to the minimum redundancy over the class of all codes having block length n and some specified type as the nth-order redundancy. In lossless source coding, the OPTA is the Shannon entropy and there exists extensive literature studying the nth-order redundancy. Before our work, nontrivial lower bounds are still unknown to either the n-th order rate redundancy or the n-th order distortion redundancy. The aim of this paper is to answer the question of whether Pilc´s (1968) lower bound is true. We derive a closed formula for the nth-order distortion redundancy and prove the formula for the upper and lower bounds of the nth-order rate redundancy
Keywords :
entropy; rate distortion theory; redundancy; source coding; Pilc´s lower bound; Shannon entropy; block length; closed formula; common parameter; distortion redundancy; lossless source coding; lossy source coding; minimum redundancy; nontrivial lower bounds; optimum performance theoretically attainable; rate redundancy; redundancy; redundancy problem; source code; upper bound; Block codes; Entropy; Production; Rate distortion theory; Rate-distortion; Source coding; Statistics;
Conference_Titel :
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Conference_Location :
Whistler, BC
Print_ISBN :
0-7803-2453-6
DOI :
10.1109/ISIT.1995.531539