Title :
A note on conditional entropy
Author :
Wang Yong ; Huang Jinxiang ; Wang Huadeng
Author_Institution :
Coll. of Comput. & Control, Guilin Univ. of Electron. Technol., Guilin, China
Abstract :
The problems of conditional entropy´s definition and the formula to compute conditional entropy are analyzed from various perspectives. Examples are given to prove the conclusion that conditional entropy never be increased is not absolute, thus the representation that information is to decrease uncertainty in the definition of information is not absolutely correct. In most conditions the reduction of uncertainty is just a byproduct by the aim of reliability. It is more important to increase the reliability of information than to reduce the uncertainty of information.
Keywords :
entropy; reliability; conditional entropy; information reliability; information theory; Cities and towns; Educational institutions; Entropy; Information theory; Measurement uncertainty; Thermodynamics; conditional entropy; information theory; probability; uncertainty;
Conference_Titel :
Computer Science and Information Technology, 2009. ICCSIT 2009. 2nd IEEE International Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4244-4519-6
Electronic_ISBN :
978-1-4244-4520-2
DOI :
10.1109/ICCSIT.2009.5234648
