Title :
A New Bound in Information Theory
Author :
Popescu, George Pantelimon ; Slusanschi, Emil-Ioan
Author_Institution :
Comput. Sci. & Eng. Dept., Univ. Politeh. of Bucharest, Bucharest, Romania
Abstract :
Shannon Entropy, for discrete-valued random variables, plays important roles in information theory. The purpose of this paper is to present a new bound for the Shannon Entropy, by developing a refinement of Jensen´s inequality.
Keywords :
information theory; random processes; refinement calculus; Jensen inequality refinement; Shannon entropy bound; discrete-valued random variables; information theory; Computer science; Control systems; Convex functions; Entropy; Mutual information; Upper bound; Information theory; Jensen´s inequality; bounds; entropy; refinements;
Conference_Titel :
Control Systems and Computer Science (CSCS), 2015 20th International Conference on
Conference_Location :
Bucharest
Print_ISBN :
978-1-4799-1779-2
DOI :
10.1109/CSCS.2015.117
