DocumentCode
895085
Title
Extension of an entropy property for binary input memoryless symmetric channels
Author
Chayat, Naftali ; Shamai, Shlomo
Author_Institution
Dept. of Electr. Eng., Technion, Haifa, Israel
Volume
35
Issue
5
fYear
1989
fDate
9/1/1989 12:00:00 AM
Firstpage
1077
Lastpage
1079
Abstract
The channel output entropy property introduced by A.D. Wyner and J. Ziv (ibid., vol.IT-19, p.769-762, Nov.1973) for a binary symmetric channel is extended to arbitrary memoryless symmetric channels with binary inputs and discrete or continuous outputs. This yields lower bounds on the achievable information rates of these channels under constrained binary inputs. Using the interpretation of entropy as a measure of order and randomness, the authors deduce that output sequences of memoryless symmetric channels induced by binary inputs are of a higher degree of randomness if the redundancy of the input binary sequence is spread in memory rather than in one-dimensional asymmetry. It is of interest to characterize the general class of schemes for which this interpretation holds
Keywords
entropy; information theory; telecommunication channels; achievable information rates; arbitrary memoryless symmetric channels; binary inputs; binary symmetric channel; channel output entropy property; continuous outputs; discrete outputs; lower bounds; randomness; redundancy; Cities and towns; Entropy; Gaussian channels; Information rates; Memoryless systems; Probability density function; Terminology;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.42224
Filename
42224
Link To Document