• DocumentCode
    754531
  • Title

    Universal denoising for the finite-input general-output channel

  • Author

    Dembo, Amir ; Weissman, Tsachy

  • Author_Institution
    Depts. of Math. & Stat., Stanford Univ., CA, USA
  • Volume
    51
  • Issue
    4
  • fYear
    2005
  • fDate
    4/1/2005 12:00:00 AM
  • Firstpage
    1507
  • Lastpage
    1517
  • Abstract
    We consider the problem of reconstructing a finite-alphabet signal corrupted by a known memoryless channel with a general output alphabet. The goodness of the reconstruction is measured by a given loss function. We (constructively) establish the existence of a universal (sequence of) denoiser(s) attaining asymptotically the optimum distribution-dependent performance for any stationary source that may be generating the noiseless signal. We show, in fact, that there is a whole family of denoiser sequences with this property. These schemes are shown to be universal also in a semistochastic setting, where the only randomness assumed is that associated with the channel noise. The scheme is practical, requiring O(n1+ε) operations (for any ε>0) and working storage size sublinear in the input data length. This extends recent work that presented a discrete universal denoiser for recovering a discrete source corrupted by a discrete memoryless channel (DMC).
  • Keywords
    binary sequences; optimisation; quantisation (signal); signal denoising; signal reconstruction; telecommunication channels; DMC; discrete memoryless channel noise; discrete universal denoising; finite-alphabet signal reconstruction; individual sequences; noiseless signal; optimum distribution-dependent performance; quantization; semistochastic setting; sliding-window schemes; stationary source; universal algorithms; Codes; Information theory; Loss measurement; Memoryless systems; Noise measurement; Noise reduction; Performance loss; Random processes; Random variables; Source coding; Denoising; discrete universal denoising; filtering; individual sequences; memoryless channels; noisy channels; quantization; sliding-window schemes; universal algorithms;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2005.844104
  • Filename
    1412043