DocumentCode
3238177
Title
How do the structure and the parameters of Gaussian tree models affect structure learning?
Author
Tan, Vincent Y F ; Anandkumar, Animashree ; Willsky, Alan S.
Author_Institution
Lab. for Inf. & Decision Syst., Massachusetts Inst. of Technol., Cambridge, MA, USA
fYear
2009
fDate
Sept. 30 2009-Oct. 2 2009
Firstpage
684
Lastpage
691
Abstract
The problem of learning tree-structured Gaussian graphical models from i.i.d. samples is considered. The influence of the tree structure and the parameters of the Gaussian distribution on the learning rate as the number of samples increases is discussed. Specifically, the error exponent corresponding to the event that the estimated tree structure differs from the actual unknown tree structure of the distribution is analyzed. Finding the error exponent reduces to a least-squares problem in the very noisy learning regime. In this regime, it is shown that universally, the extremal tree structures which maximize and minimize the error exponent are the star and the Markov chain for any fixed set of correlation coefficients on the edges of the tree. In other words, the star and the chain graphs represent the hardest and the easiest structures to learn in the class of tree-structured Gaussian graphical models. This result can also be intuitively explained by correlation decay: pairs of nodes which are far apart, in terms of graph distance, are unlikely to be mistaken as edges by the maximum-likelihood estimator in the asymptotic regime.
Keywords
Gaussian distribution; Markov processes; learning (artificial intelligence); least mean squares methods; maximum likelihood estimation; trees (mathematics); Gaussian distribution; Gaussian tree models; Markov chain; chain graphs; correlation coefficients; correlation decay; error exponent maximization; error exponent minimization; extremal tree structures; graph distance; least-squares problem; maximum-likelihood estimator; structure learning; tree-structured Gaussian graphical models; Computer errors; Error probability; Gaussian distribution; Graphical models; Laboratories; Maximum likelihood estimation; Noise reduction; Stochastic systems; Tree data structures; Tree graphs; Error exponents; Euclidean information theory; Gaussian graphical models; Large deviations; Structure learning; Tree distributions;
fLanguage
English
Publisher
ieee
Conference_Titel
Communication, Control, and Computing, 2009. Allerton 2009. 47th Annual Allerton Conference on
Conference_Location
Monticello, IL
Print_ISBN
978-1-4244-5870-7
Type
conf
DOI
10.1109/ALLERTON.2009.5394929
Filename
5394929
Link To Document