DocumentCode
2345376
Title
Shannon-Hartley entropy ratio under Zipf law
Author
Krichevskii, R.E. ; Scharova, M.P.
Author_Institution
Math. Inst., Novosibirsk State Univ., Russia
fYear
1994
fDate
27-29 Oct 1994
Firstpage
66
Abstract
We find a formula for Shannon´s-Hartley´s entropy Ratio of a text governed by the Zipf law. The formula is in a good agreement with real texts. It is asymptotically 1/2+loglog|D|/log|D||D| being the size of the text´s dictionary, lim|D|=∞. It means that a word to variable length code might significantly outperform a word to fixed length one for large dictionaries only
Keywords
entropy; variable length codes; word processing; Shannon-Hartley entropy ratio; Zipf law; fixed length code; large dictionaries; text; text dictionary size; variable length code; Books; Costs; Dictionaries; Entropy; Frequency;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory and Statistics, 1994. Proceedings., 1994 IEEE-IMS Workshop on
Conference_Location
Alexandria, VA
Print_ISBN
0-7803-2761-6
Type
conf
DOI
10.1109/WITS.1994.513895
Filename
513895
Link To Document