Title :
On data-driven histogram-based estimation for mutual information
Author :
Silva, Jorge ; Narayanan, Shrikanth S.
Author_Institution :
Dept. of Electr. Eng., Univ. of Chile, Santiago, Chile
Abstract :
The problem of mutual information (MI) estimation based on data-dependent partition is addressed in this work. Sufficient conditions are stipulated on a histogram-based construction to guarantee a strong consistent estimate for the MI. The practical implications of this result are in the specification of a range of design parameters for two data-driven histogram-based approaches - statistically equivalent blocks and tree-structure vector quantizations - to yield density-free strongly consistent estimates for the MI.
Keywords :
image coding; statistical analysis; vector quantisation; data-dependent partition; data-driven histogram-based estimation; mutual information estimation; tree-structure vector quantizations; Feature extraction; Image registration; Information theory; Mutual information; Probability; Q measurement; Random variables; Sufficient conditions; Vector quantization; Yield estimation;
Conference_Titel :
Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on
Conference_Location :
Austin, TX
Print_ISBN :
978-1-4244-7890-3
Electronic_ISBN :
978-1-4244-7891-0
DOI :
10.1109/ISIT.2010.5513635
