• DocumentCode
    1103367
  • Title

    Why Gaussianity?

  • Author

    Kiseon Kim ; Shevlyakov, Georgy

  • Author_Institution
    Gwangju Inst. of Sci. & Technol., Gwangju
  • Volume
    25
  • Issue
    2
  • fYear
    2008
  • fDate
    3/1/2008 12:00:00 AM
  • Firstpage
    102
  • Lastpage
    113
  • Abstract
    In this article, we try to answer the question: "Why the ubiquitous use and success of the Gaussian distribution law?". The history of the Gaussian or normal distribution is rather long, having existed for nearly 300 years since it was discovered by de Moivre in 1733, and the related literature is immense. An extended and thorough treatment of the topic and a survey of the works in the related area are given in the posthumously edited book of E.T. Jaynes (2003), and we partially follow this source, in particular while considering the history of the posed question. The important aspects of the general history of noise, especially of Brownian motion, are given by Cohen (2005). Our main contribution to the topic is concerned with highlighting the role of Gaussian models in signal processing based on the optimal property of the Gaussian distribution minimizing Fisher information over the class of distributions with a bounded variance. We deal only with the univariate Gaussian distribution, omitting the properties of multivariate Gaussian distribution. First of all, we present the ideas of classical derivations of the Gaussian law. Then we consider its properties and characterizations including the central limit theorem (CLT) and minimization of the distribution entropy and Fisher information. Finally, we dwell on the connections between Gaussianity and robustness in signal processing.
  • Keywords
    Gaussian distribution; entropy; signal processing; Brownian motion; Fisher information minimization; Gaussian distribution law; Gaussian models; central limit theorem; distribution entropy minimization; normal distribution; signal processing; univariate Gaussian distribution; Books; Entropy; Equations; Gaussian distribution; Gaussian processes; History; Limiting; Linear regression; Signal processing; Vectors;
  • fLanguage
    English
  • Journal_Title
    Signal Processing Magazine, IEEE
  • Publisher
    ieee
  • ISSN
    1053-5888
  • Type

    jour

  • DOI
    10.1109/MSP.2007.913700
  • Filename
    4472249