DocumentCode
754531
Title
Universal denoising for the finite-input general-output channel
Author
Dembo, Amir ; Weissman, Tsachy
Author_Institution
Depts. of Math. & Stat., Stanford Univ., CA, USA
Volume
51
Issue
4
fYear
2005
fDate
4/1/2005 12:00:00 AM
Firstpage
1507
Lastpage
1517
Abstract
We consider the problem of reconstructing a finite-alphabet signal corrupted by a known memoryless channel with a general output alphabet. The goodness of the reconstruction is measured by a given loss function. We (constructively) establish the existence of a universal (sequence of) denoiser(s) attaining asymptotically the optimum distribution-dependent performance for any stationary source that may be generating the noiseless signal. We show, in fact, that there is a whole family of denoiser sequences with this property. These schemes are shown to be universal also in a semistochastic setting, where the only randomness assumed is that associated with the channel noise. The scheme is practical, requiring O(n1+ε) operations (for any ε>0) and working storage size sublinear in the input data length. This extends recent work that presented a discrete universal denoiser for recovering a discrete source corrupted by a discrete memoryless channel (DMC).
Keywords
binary sequences; optimisation; quantisation (signal); signal denoising; signal reconstruction; telecommunication channels; DMC; discrete memoryless channel noise; discrete universal denoising; finite-alphabet signal reconstruction; individual sequences; noiseless signal; optimum distribution-dependent performance; quantization; semistochastic setting; sliding-window schemes; stationary source; universal algorithms; Codes; Information theory; Loss measurement; Memoryless systems; Noise measurement; Noise reduction; Performance loss; Random processes; Random variables; Source coding; Denoising; discrete universal denoising; filtering; individual sequences; memoryless channels; noisy channels; quantization; sliding-window schemes; universal algorithms;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2005.844104
Filename
1412043
Link To Document