DocumentCode
3301334
Title
A revisit to the Muroga method of computing channel capacity
Author
Kawabata, Tsutomu
Author_Institution
Dept. of Commun. Eng. & Inf., Univ. of Electro-Commun., Chofu, Japan
fYear
2010
fDate
17-20 Oct. 2010
Firstpage
801
Lastpage
806
Abstract
The Muroga method is an algebraic method of computing the capacity of discrete memoryless channels. Shannon interpreted the method geometrically. However, in the process, he ignored the meaning of the intermediate vector x, although which played a key computational role in Muroga´s work. Although Shannon´s view was inherited thereafter, by Gallager, and Csiszsár and Körner, the algebra of Muroga was not. We revisit the original Muroga method, and while following Shannon´s view, will give a geometry of Muroga´s algebraic computation. This view enables new applications. One class of application is directly related to the capacity computation; We first give a sensitivity analysis of the capacity. Next, we give a capacity computation algorithm for the channels which have more input symbols than the output symbols. The other class of application is the universal noiseless source coding, in particular, the universal expected redundancy. For the latter, we propose a new (Muroga) upper bound and a stochastic complexity bound.
Keywords
algebra; channel capacity; sensitivity analysis; source coding; stochastic processes; Muroga method; algebraic method; channel capacity; discrete memoryless channels; sensitivity analysis; stochastic complexity bound; universal expected redundancy; universal noiseless source coding; upper bound; Channel capacity; Complexity theory; Entropy; Equations; Geometry; Indexes; Sensitivity analysis;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory and its Applications (ISITA), 2010 International Symposium on
Conference_Location
Taichung
Print_ISBN
978-1-4244-6016-8
Electronic_ISBN
978-1-4244-6017-5
Type
conf
DOI
10.1109/ISITA.2010.5649611
Filename
5649611
Link To Document