• DocumentCode
    2423029
  • Title

    Relationships among bounds for the region of entropic vectors in four variables

  • Author

    Walsh, John MacLaren ; Weber, Steven

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Drexel Univ., Philadelphia, PA, USA
  • fYear
    2010
  • fDate
    Sept. 29 2010-Oct. 1 2010
  • Firstpage
    1319
  • Lastpage
    1326
  • Abstract
    Extreme point representations are utilized together with facet membership to gain insights about the relationship between various bounds on the set of normalized entropic vectors in 4 random variables. Echoing prior results from Matúš (1995), we begin by showing that the 206 extreme points of the Shannon outer bound comprise 33 forms where 16 of these forms are entropic and achievable with binary random variables (one bit), 16 of the forms are entropic and achievable using two bits, and the remaining single form of six extreme points is not entropic, not achievable with two bits, and is the only violator of the Ingleton inequality. Thus, the Ingleton inner bound is matched to the Shannon outer bound in that it contains all entropic Shannon extreme points. Further novel investigation of the structure of the Ingleton and Shannon polytopes reveal that every facet of the Shannon outer bound requires two bits per variable and can be improved upon. The inner bound formed from the convex hull of the set of binary entropic vectors is shown to neither contain nor be contained in the Ingleton inner bound, and is shown to not be a polytope. The addition of the non-Shannon-type inequality due to Zhang and Yueng plus the six non-Shannon-type inequalities due to Dougherty, Freiling, and Zeger yield a polytopic outer bound where none of the non-Shannon extreme points obey Ingleton or are binary achievable. Worst case distance gaps between the various bounds are calculated.
  • Keywords
    information theory; Shannon outer bound; binary entropic vectors; extreme point representations; Channel coding; Classification algorithms; Cramer-Rao bounds; Entropy; Joints; Random variables; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference on
  • Conference_Location
    Allerton, IL
  • Print_ISBN
    978-1-4244-8215-3
  • Type

    conf

  • DOI
    10.1109/ALLERTON.2010.5707066
  • Filename
    5707066