• DocumentCode
    895085
  • Title

    Extension of an entropy property for binary input memoryless symmetric channels

  • Author

    Chayat, Naftali ; Shamai, Shlomo

  • Author_Institution
    Dept. of Electr. Eng., Technion, Haifa, Israel
  • Volume
    35
  • Issue
    5
  • fYear
    1989
  • fDate
    9/1/1989 12:00:00 AM
  • Firstpage
    1077
  • Lastpage
    1079
  • Abstract
    The channel output entropy property introduced by A.D. Wyner and J. Ziv (ibid., vol.IT-19, p.769-762, Nov.1973) for a binary symmetric channel is extended to arbitrary memoryless symmetric channels with binary inputs and discrete or continuous outputs. This yields lower bounds on the achievable information rates of these channels under constrained binary inputs. Using the interpretation of entropy as a measure of order and randomness, the authors deduce that output sequences of memoryless symmetric channels induced by binary inputs are of a higher degree of randomness if the redundancy of the input binary sequence is spread in memory rather than in one-dimensional asymmetry. It is of interest to characterize the general class of schemes for which this interpretation holds
  • Keywords
    entropy; information theory; telecommunication channels; achievable information rates; arbitrary memoryless symmetric channels; binary inputs; binary symmetric channel; channel output entropy property; continuous outputs; discrete outputs; lower bounds; randomness; redundancy; Cities and towns; Entropy; Gaussian channels; Information rates; Memoryless systems; Probability density function; Terminology;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.42224
  • Filename
    42224