Title :
An information-theoretic proof of Burg´s maximum entropy spectrum
Author :
Choi, B.S. ; Cover, Thomas M.
Author_Institution :
Yonsei University, Seoul, Korea
Abstract :
It is known that the maximum entropy stationary Gaussian stochastic process, subject to a finite number of autocorrelation constraints, is the Gauss-Markov process of appropriate order. The associated spectrum is Burg´s maximum entropy spectral density. We pose a somewhat broader entropy maximization problem, in which stationarity and normality are not assumed, and shift the burden of proof from the previous focus on the calculus of variations and time series techniques to a string of information-theoretic inequalities. This results in an elementary proof of greater generality.
Keywords :
Autocorrelation; Calculus; Covariance matrix; Entropy; Gaussian processes; Interpolation; Markov processes; Matrix decomposition; Stochastic processes; Vectors;
Journal_Title :
Proceedings of the IEEE
DOI :
10.1109/PROC.1984.12981