Analyses on Limitations of Information Theory

Author

Wang, Yong

Author_Institution

Coll. of Comput. & Control, Guilin Univ. of Electron. Technol., Guilin, China

Volume

1

fYear

2009

fDate

7-8 Nov. 2009

Firstpage

85

Lastpage

88

Abstract

The paper analyzes the limitations from the angles of conditional entropy and the expression of information. It is pointed out Shannon´s definition of information is not absolute and the probability in the expression of information maybe random variable in practice, but in information theory the probability is treated as a fixed value, then the application of Shannon´s theory is limited. It is stated that people would select information that is more reliable but more uncertain than the reverse in practice. The signality of the reliability of information which is ignored in Shannon´s information theory is indicated and the clew to measure the reliability of information is given to be the uncertainty of probability.

Keywords

entropy; Shannon theory; conditional entropy; information theory; Artificial intelligence; Computational intelligence; Educational institutions; Electric variables control; Entropy; Information analysis; Information theory; Random variables; Reliability theory; Uncertainty; conditional entropy; information theory; measure; probability; uncertainty;

fLanguage

English

Publisher

ieee

Conference_Titel

Artificial Intelligence and Computational Intelligence, 2009. AICI '09. International Conference on

Conference_Location

Shanghai

Print_ISBN

978-1-4244-3835-8

Electronic_ISBN

978-0-7695-3816-7

Type

conf

DOI

10.1109/AICI.2009.413

Filename

5376021