Title :
Multivariate Generalized Gaussian Distribution: Convexity and Graphical Models
Author :
Teng Zhang ; Wiesel, Ami ; Greco, Maria S.
Author_Institution :
Inst. for Math. & its Applic., Univ. of Minnesota, Minneapolis, MN, USA
Abstract :
We consider covariance estimation in the multivariate generalized Gaussian distribution (MGGD) and elliptically symmetric (ES) distribution. The maximum likelihood optimization associated with this problem is non-convex, yet it has been proved that its global solution can be often computed via simple fixed point iterations. Our first contribution is a new analysis of this likelihood based on geodesic convexity that requires weaker assumptions. Our second contribution is a generalized framework for structured covariance estimation under sparsity constraints. We show that the optimizations can be formulated as convex minimization as long the MGGD shape parameter is larger than half and the sparsity pattern is chordal. These include, for example, maximum likelihood estimation of banded inverse covariances in multivariate Laplace distributions, which are associated with time varying autoregressive processes.
Keywords :
Gaussian distribution; Laplace equations; autoregressive processes; convex programming; covariance analysis; differential geometry; graph theory; maximum likelihood estimation; minimisation; ES distribution; MGGD shape parameter; banded inverse covariances; chordal sparsity pattern; convex minimization; elliptically symmetric distribution; generalized framework; geodesic convexity; global solution; graphical models; maximum likelihood estimation; maximum likelihood optimization; multivariate Laplace distributions; multivariate generalized Gaussian distribution; nonconvex problem; sparsity constraints; structured covariance estimation; time varying autoregressive processes; Cholesky decomposition; geodesic convexity; graphical models; multivariate generalized Gaussian distribution;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2013.2267740