Title :
Entropy in communication and chemical systems
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, CA
Abstract :
Entropy plays a central role in communication systems. On the one hand, the objective of communication is to reduce the entropy of some random variable. On the other hand, many useful models of communication networks evolve to a state of maximum entropy given external constraints. Chemical systems also exhibit a similar entropy-maximizing property, as do many systems of interacting particles. This paper reviews this set of fundamental ideas.
Keywords :
entropy; maximum entropy methods; reaction kinetics theory; telecommunication networks; chemical systems; communication systems; entropy-maximizing property; interacting particles; random variable; reaction rates; Chemical engineering; Communication networks; Dictionaries; Encoding; Entropy; Measurement uncertainty; Random processes; Random variables; Telephony; Thermodynamics;
Conference_Titel :
Applied Sciences on Biomedical and Communication Technologies, 2008. ISABEL '08. First International Symposium on
Conference_Location :
Aalborg
Print_ISBN :
978-1-4244-2647-8
Electronic_ISBN :
978-1-4244-2648-5
DOI :
10.1109/ISABEL.2008.4712620