Title :
Improved upper bounds to the causal quadratic rate-distortion function for Gaussian stationary sources
Author :
Derpich, Milan S. ; Østergaard, Jan
Author_Institution :
Dept. of Electron. Eng., Univ. Tec. Federico Santa Maria, Valparaíso, Chile
Abstract :
We improve the existing achievable rate regions for causal and for zero-delay source coding of stationary Gaussian sources for mean squared error (MSE) distortion. First, we define the information-theoretic causal rate-distortion function (RDF), Rcit(D). In order to analyze Rcit(D), we introduce Rcit̅(D), the information theoretic causal RDF when reconstruction error is jointly stationary with the source. Based upon Rcit̅(D), we derive four closed form upper bounds to the gap between Rcit̅(D) and Shannon´s RDF, two of them strictly smaller than 0.5 bits/sample at all rates. We then show that Rcit̅(D) can be realized by an AWGN channel surrounded by a unique set of causal pre-, post-, and feedback filters. We show that finding such filters constitutes a convex optimization problem and propose an iterative procedure to solve it. Finally, we build upon Rcit̅(D) to improve existing bounds on the optimal performance attainable by causal and zero-delay codes.
Keywords :
AWGN channels; convex programming; iterative methods; mean square error methods; rate distortion theory; sequential codes; source coding; AWGN channel; Gaussian stationary sources; Shannon RDF; causal prefilters; causal quadratic rate-distortion function; causal source coding; convex optimization problem; feedback filters; improved upper bounds; information theory; mean squared error distortion; post filters; reconstruction error; sequential coding; zero-delay source coding; AWGN channels; Entropy; Filters; Gaussian processes; Information analysis; Pulse modulation; Rate-distortion; Resource description framework; Source coding; Upper bound; Causality; convex optimization; differential pulse-code modulation (DPCM); entropy coded dithered quantization; noise-shaping; rate-distortion theory; sequential coding;
Conference_Titel :
Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on
Conference_Location :
Austin, TX
Print_ISBN :
978-1-4244-7890-3
Electronic_ISBN :
978-1-4244-7891-0
DOI :
10.1109/ISIT.2010.5513282