Title :
Refined bounds on the empirical distribution of good channel codes via concentration inequalities
Author :
Raginsky, Maxim ; Sason, Igal
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
Abstract :
We derive sharpened inequalities on the empirical output distribution of good channel codes with deterministic encoders and with non-vanishing maximal probability of decoding error. These inequalities refine recent bounds of Polyanskiy and Verdú by identifying closed-form expressions for certain asymptotic terms, which facilitates their calculation for finite blocklengths. The analysis relies on concentration-of-measure inequalities, specifically on McDiarmid´s method of bounded differences and its close ties to transportation inequalities for weighted Hamming metrics. An operational implication of the new bounds is addressed.
Keywords :
Hamming codes; decoding; McDiarmid method; Polyanskiy bound; Verdu bound; channel codes; closed-form expressions; concentration inequalities; concentration-of-measure inequalities; decoding error; deterministic encoders; empirical distribution; empirical output distribution; nonvanishing maximal probability; refined bounds; transportation inequalities; weighted Hamming metrics; Decoding; Educational institutions; Encoding; Measurement; Random variables; Transportation;
Conference_Titel :
Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
Conference_Location :
Istanbul
DOI :
10.1109/ISIT.2013.6620220