• DocumentCode
    3301334
  • Title

    A revisit to the Muroga method of computing channel capacity

  • Author

    Kawabata, Tsutomu

  • Author_Institution
    Dept. of Commun. Eng. & Inf., Univ. of Electro-Commun., Chofu, Japan
  • fYear
    2010
  • fDate
    17-20 Oct. 2010
  • Firstpage
    801
  • Lastpage
    806
  • Abstract
    The Muroga method is an algebraic method of computing the capacity of discrete memoryless channels. Shannon interpreted the method geometrically. However, in the process, he ignored the meaning of the intermediate vector x, although which played a key computational role in Muroga´s work. Although Shannon´s view was inherited thereafter, by Gallager, and Csiszsár and Körner, the algebra of Muroga was not. We revisit the original Muroga method, and while following Shannon´s view, will give a geometry of Muroga´s algebraic computation. This view enables new applications. One class of application is directly related to the capacity computation; We first give a sensitivity analysis of the capacity. Next, we give a capacity computation algorithm for the channels which have more input symbols than the output symbols. The other class of application is the universal noiseless source coding, in particular, the universal expected redundancy. For the latter, we propose a new (Muroga) upper bound and a stochastic complexity bound.
  • Keywords
    algebra; channel capacity; sensitivity analysis; source coding; stochastic processes; Muroga method; algebraic method; channel capacity; discrete memoryless channels; sensitivity analysis; stochastic complexity bound; universal expected redundancy; universal noiseless source coding; upper bound; Channel capacity; Complexity theory; Entropy; Equations; Geometry; Indexes; Sensitivity analysis;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory and its Applications (ISITA), 2010 International Symposium on
  • Conference_Location
    Taichung
  • Print_ISBN
    978-1-4244-6016-8
  • Electronic_ISBN
    978-1-4244-6017-5
  • Type

    conf

  • DOI
    10.1109/ISITA.2010.5649611
  • Filename
    5649611