Title :
Universal denoising for the finite-input general-output channel
Author :
Dembo, Amir ; Weissman, Tsachy
Author_Institution :
Depts. of Math. & Stat., Stanford Univ., CA, USA
fDate :
4/1/2005 12:00:00 AM
Abstract :
We consider the problem of reconstructing a finite-alphabet signal corrupted by a known memoryless channel with a general output alphabet. The goodness of the reconstruction is measured by a given loss function. We (constructively) establish the existence of a universal (sequence of) denoiser(s) attaining asymptotically the optimum distribution-dependent performance for any stationary source that may be generating the noiseless signal. We show, in fact, that there is a whole family of denoiser sequences with this property. These schemes are shown to be universal also in a semistochastic setting, where the only randomness assumed is that associated with the channel noise. The scheme is practical, requiring O(n1+ε) operations (for any ε>0) and working storage size sublinear in the input data length. This extends recent work that presented a discrete universal denoiser for recovering a discrete source corrupted by a discrete memoryless channel (DMC).
Keywords :
binary sequences; optimisation; quantisation (signal); signal denoising; signal reconstruction; telecommunication channels; DMC; discrete memoryless channel noise; discrete universal denoising; finite-alphabet signal reconstruction; individual sequences; noiseless signal; optimum distribution-dependent performance; quantization; semistochastic setting; sliding-window schemes; stationary source; universal algorithms; Codes; Information theory; Loss measurement; Memoryless systems; Noise measurement; Noise reduction; Performance loss; Random processes; Random variables; Source coding; Denoising; discrete universal denoising; filtering; individual sequences; memoryless channels; noisy channels; quantization; sliding-window schemes; universal algorithms;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2005.844104