Title :
Enumerative coding for tree sources
Author :
Martin, Andrew ; Seroussi, Gadiel ; Weinberger, Marcelo
Author_Institution :
Univ. de la Republica, Montevideo
Abstract :
Efficient enumerative coding for tree sources is, in general, surprisingly intricate-a simple uniform encoding of type classes, which is asymptotically optimal in expectation for many classical models such as FSMs, turns out not to be so in this case. We describe an efficiently computable enumerative code that is universal in the class of tree sources in the sense that, for a string emitted by an unknown source supported on a known tree, the expected normalized code length approaches the entropy rate of the source with a convergence rate (K/2)(log n)/n, where K is the number of free parameters of the source. The results extend also to the twice-universal setting, where the tree is unknown.
Keywords :
entropy; source coding; trees (mathematics); variable length codes; entropy rate; enumerative coding; normalized code length; tree sources; Convergence; Data compression; Encoding; Entropy; Information theory; Laboratories; Maximum likelihood decoding; Parametric statistics; State estimation; Yield estimation;
Conference_Titel :
Information Theory, 2008. ISIT 2008. IEEE International Symposium on
Conference_Location :
Toronto, ON
Print_ISBN :
978-1-4244-2256-2
Electronic_ISBN :
978-1-4244-2257-9
DOI :
10.1109/ISIT.2008.4595433