Title :
Shannon-Hartley entropy ratio under Zipf law
Author :
Krichevskii, R.E. ; Scharova, M.P.
Author_Institution :
Math. Inst., Novosibirsk State Univ., Russia
Abstract :
We find a formula for Shannon´s-Hartley´s entropy Ratio of a text governed by the Zipf law. The formula is in a good agreement with real texts. It is asymptotically 1/2+loglog|D|/log|D||D| being the size of the text´s dictionary, lim|D|=∞. It means that a word to variable length code might significantly outperform a word to fixed length one for large dictionaries only
Keywords :
entropy; variable length codes; word processing; Shannon-Hartley entropy ratio; Zipf law; fixed length code; large dictionaries; text; text dictionary size; variable length code; Books; Costs; Dictionaries; Entropy; Frequency;
Conference_Titel :
Information Theory and Statistics, 1994. Proceedings., 1994 IEEE-IMS Workshop on
Conference_Location :
Alexandria, VA
Print_ISBN :
0-7803-2761-6
DOI :
10.1109/WITS.1994.513895
