DocumentCode
3118495
Title
Universality in polytope phase transitions and iterative algorithms
Author
Bayati, Mohsen ; Lelarge, Marc ; Montanari, Andrea
Author_Institution
Grad. Sch. of Bus., Stanford Univ., Stanford, CA, USA
fYear
2012
fDate
1-6 July 2012
Firstpage
1643
Lastpage
1647
Abstract
We consider a class of nonlinear mappings FA, N in RN indexed by symmetric random matrices A ϵ RN×N with independent entries. Within spin glass theory, special cases of these mappings correspond to iterating the TAP equations and were studied by Erwin Bolthausen. Within information theory, they are known as `approximate message passing´ algorithms. We study the high-dimensional (large N) behavior of the iterates of F for polynomial functions F, and prove that it is universal, i.e. it depends only on the first two moments of the entries of A. As an application, we prove the universality of a certain phase transition arising in polytope geometry and compressed sensing. This solves a conjecture by David Donoho and Jared Tanner.
Keywords
compressed sensing; geometry; information theory; iterative methods; matrix algebra; message passing; polynomial approximation; random processes; TAP equations; approximate message passing algorithms; compressed sensing; high-dimensional behavior; information theory; iterative algorithms; nonlinear mappings; polynomial functions; polytope geometry; polytope phase transition universality; spin glass theory; symmetric random matrices; Compressed sensing; Face; Geometry; Message passing; Polynomials; Symmetric matrices; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2012 IEEE International Symposium on
Conference_Location
Cambridge, MA
ISSN
2157-8095
Print_ISBN
978-1-4673-2580-6
Electronic_ISBN
2157-8095
Type
conf
DOI
10.1109/ISIT.2012.6283554
Filename
6283554
Link To Document