Title :
Large deviations of probability rank
Author_Institution :
Dept. of Electr. Eng., Bilkent Univ., Ankara, Turkey
Abstract :
Consider a pair of random variables (X,Y) with distribution P. The probability rank function is defined so that G(x|y)=1 for the most probable outcome x conditional on Y=y, G(x|y)=2 for the second most probable outcome, and so on, resolving ties between elements with equal probabilities arbitrarily. The function G was considered in Arikan (1996) in the context of finding the unknown outcome of a random experiment by asking questions of the form `is the outcome equal to x?´ sequentially until the actual outcome is determined. The primary focus in Arakan (1996) and Arakan and Merhav (1998) was to find tight bounds on the moments E[G(X|Y)θ]. The present work is closely related to these works but focuses more directly on the large deviations properties of the probability rank function
Keywords :
combined source-channel coding; entropy; probability; random processes; probability rank deviations; probability rank function; random experiment; random variables; unknown outcome; Block codes; Channel coding; Decoding; Entropy; H infinity control; Information theory; Random variables; Source coding;
Conference_Titel :
Information Theory, 2000. Proceedings. IEEE International Symposium on
Conference_Location :
Sorrento
Print_ISBN :
0-7803-5857-0
DOI :
10.1109/ISIT.2000.866317