• DocumentCode
    2022588
  • Title

    Entropy with Limited Computation Resources

  • Author

    Sohangir, S. ; Linscott, I.

  • Author_Institution
    Stanford Univ., Stanford
  • fYear
    2007
  • fDate
    24-29 June 2007
  • Firstpage
    496
  • Lastpage
    500
  • Abstract
    We consider information in presence of computation limitations. Specifically, we consider the following question. What is the output entropy of a computation if no (or limited) computation resources are available. We first explain two notions of effective input information and the average number of decisions in a computation problem and show how these notions can helps us understand the output entropy of a computation when computation resources are limited. Then we propose a procedure to evaluate output entropy in such scenarios and show that it satisfies some nice properties.
  • Keywords
    computational complexity; entropy; computation complexity; information theory; limited computation resources; output entropy; Boolean functions; Circuits; Complexity theory; Computer networks; Distributed computing; Entropy; Information analysis; Information theory; Probability distribution; Very large scale integration;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2007. ISIT 2007. IEEE International Symposium on
  • Conference_Location
    Nice
  • Print_ISBN
    978-1-4244-1397-3
  • Type

    conf

  • DOI
    10.1109/ISIT.2007.4557274
  • Filename
    4557274