Title :
Rényi entropy dimension of the mixture of measures
Author :
Smieja, Marek ; Tabor, Jacek
Author_Institution :
Fac. of Math. & Comput. Sci., Jagiellonian Univ., Kraków, Poland
Abstract :
Rényi entropy dimension describes the rate of growth of coding cost in the process of lossy data compression in the case of exponential dependence between the code length and the cost of coding. In this paper we generalize the Csiszár estimation of the Rényi entropy dimension of the mixture of measures for the case of general probability metric space. This result determines the cost of encoding of the information which comes from the combined sources assuming its exponential growth. Our proof relies on an equivalent definition of the Rényi entropy in weighted form which allows to deal well with a calculation of the entropy of the mixture of measures.
Keywords :
data compression; encoding; entropy; estimation theory; probability; Csiszár estimation; Rényi entropy dimension; code length; coding cost; combined sources; exponential dependence; general probability metric space; lossy data compression; mixture of measures; Channel coding; Entropy; Estimation; Extraterrestrial measurements; Weight measurement; Rényi entropy; Rényi entropy dimension; coding; weighted entropy;
Conference_Titel :
Science and Information Conference (SAI), 2014
Conference_Location :
London
Print_ISBN :
978-0-9893-1933-1
DOI :
10.1109/SAI.2014.6918261