DocumentCode
1103367
Title
Why Gaussianity?
Author
Kiseon Kim ; Shevlyakov, Georgy
Author_Institution
Gwangju Inst. of Sci. & Technol., Gwangju
Volume
25
Issue
2
fYear
2008
fDate
3/1/2008 12:00:00 AM
Firstpage
102
Lastpage
113
Abstract
In this article, we try to answer the question: "Why the ubiquitous use and success of the Gaussian distribution law?". The history of the Gaussian or normal distribution is rather long, having existed for nearly 300 years since it was discovered by de Moivre in 1733, and the related literature is immense. An extended and thorough treatment of the topic and a survey of the works in the related area are given in the posthumously edited book of E.T. Jaynes (2003), and we partially follow this source, in particular while considering the history of the posed question. The important aspects of the general history of noise, especially of Brownian motion, are given by Cohen (2005). Our main contribution to the topic is concerned with highlighting the role of Gaussian models in signal processing based on the optimal property of the Gaussian distribution minimizing Fisher information over the class of distributions with a bounded variance. We deal only with the univariate Gaussian distribution, omitting the properties of multivariate Gaussian distribution. First of all, we present the ideas of classical derivations of the Gaussian law. Then we consider its properties and characterizations including the central limit theorem (CLT) and minimization of the distribution entropy and Fisher information. Finally, we dwell on the connections between Gaussianity and robustness in signal processing.
Keywords
Gaussian distribution; entropy; signal processing; Brownian motion; Fisher information minimization; Gaussian distribution law; Gaussian models; central limit theorem; distribution entropy minimization; normal distribution; signal processing; univariate Gaussian distribution; Books; Entropy; Equations; Gaussian distribution; Gaussian processes; History; Limiting; Linear regression; Signal processing; Vectors;
fLanguage
English
Journal_Title
Signal Processing Magazine, IEEE
Publisher
ieee
ISSN
1053-5888
Type
jour
DOI
10.1109/MSP.2007.913700
Filename
4472249
Link To Document