DocumentCode :
944888
Title :
Note on unique decipherability
Author :
Jaynes, E.T.
Volume :
5
Issue :
3
fYear :
1959
fDate :
9/1/1959 12:00:00 AM
Firstpage :
98
Lastpage :
102
Abstract :
We consider an alphabet of a letters, used under the restrictions: 1) messages uniquely decipherable into words by use of one of the letters as a space mark, and 2) words limited to a maximum length of L letters. Although imposing these constraints simultaneously may cause a large reduction in the channel capacity of the alphabet, neither by itself causes any reduction. Accordingly, in the absence of constraints other than 1), an inequality of McMillan pertaining to uniquely decipherable messages can be made to be an equality. Defining "semi-optimal" transmission by the condition that the mean transmission time per word is minimized for a given entropy per word, we find the attainable rate of information transmission under semi-optimal conditions. Transmission at full channel capacity is a special case of semi-optimal transmission. Some generalizations and analogies to statistical mechanics are discussed.
Keywords :
Coding; Decoding; Channel capacity; Codes; Constraint theory; Decoding; Entropy; Helium; Information theory; Mechanical factors; Monitoring; Noise reduction; Sufficient conditions; Thermodynamics; Vocabulary;
fLanguage :
English
Journal_Title :
Information Theory, IRE Transactions on
Publisher :
ieee
ISSN :
0096-1000
Type :
jour
DOI :
10.1109/TIT.1959.1057500
Filename :
1057500
Link To Document :
بازگشت