DocumentCode
2269083
Title
On the redundancy of lossy source coding
Author
Zhang, Zhen ; Yang, En-Hui ; Wei, Victor K.
Author_Institution
Dept. of Electr. Eng. Syst., Univ. of Southern California, Los Angeles, CA, USA
fYear
1995
fDate
17-22 Sep 1995
Firstpage
190
Abstract
The redundancy of a source code is the difference between its expected performance and the optimum performance theoretically attainable (OPTA). In an analysis of the redundancy problem of source coding the aim is to investigate the trade-off between the minimum redundancy over a class of codes having a common parameter (such as block length) and the common parameter. We assume that the common parameter associated with the codes considered is block length. We refer to the minimum redundancy over the class of all codes having block length n and some specified type as the nth-order redundancy. In lossless source coding, the OPTA is the Shannon entropy and there exists extensive literature studying the nth-order redundancy. Before our work, nontrivial lower bounds are still unknown to either the n-th order rate redundancy or the n-th order distortion redundancy. The aim of this paper is to answer the question of whether Pilc´s (1968) lower bound is true. We derive a closed formula for the nth-order distortion redundancy and prove the formula for the upper and lower bounds of the nth-order rate redundancy
Keywords
entropy; rate distortion theory; redundancy; source coding; Pilc´s lower bound; Shannon entropy; block length; closed formula; common parameter; distortion redundancy; lossless source coding; lossy source coding; minimum redundancy; nontrivial lower bounds; optimum performance theoretically attainable; rate redundancy; redundancy; redundancy problem; source code; upper bound; Block codes; Entropy; Production; Rate distortion theory; Rate-distortion; Source coding; Statistics;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Conference_Location
Whistler, BC
Print_ISBN
0-7803-2453-6
Type
conf
DOI
10.1109/ISIT.1995.531539
Filename
531539
Link To Document