Title :
Some recovery conditions for basis learning by L1-minimization
Author :
Gribonval, Rémi ; Schnass, Karin
Author_Institution :
Centre de Rech. INRIA Rennes - Bretagne Atlantique, IRISA, Rennes
Abstract :
Many recent works have shown that if a given signal admits a sufficiently sparse representation in a given dictionary, then this representation is recovered by several standard optimization algorithms, in particular the convex l1 minimization approach. Here we investigate the related problem of inferring the dictionary from training data, with an approach where l1- minimization is used as a criterion to select a dictionary. We restrict our analysis to basis learning and identify necessary / sufficient / necessary and sufficient conditions on ideal (not necessarily very sparse) coefficients of the training data in an ideal basis to guarantee that the ideal basis is a strict local optimum of the A -minimization criterion among (not necessarily orthogonal) bases of normalized vectors. We illustrate these conditions on deterministic as well as toy random models in dimension two and highlight the main challenges that remain open by this preliminary theoretical results.
Keywords :
independent component analysis; minimisation; signal representation; sparse matrices; ICA; L1-minimization; dictionary learning; matrix algebra; normalized vector; optimization; sparse signal representation; Dictionaries; Harmonic analysis; Independent component analysis; Matching pursuit algorithms; Minimization methods; Noise reduction; Signal processing; Signal processing algorithms; Sufficient conditions; Training data; Sparse representation; dictionary learning; independent component analysis; nonconvex optimization;
Conference_Titel :
Communications, Control and Signal Processing, 2008. ISCCSP 2008. 3rd International Symposium on
Conference_Location :
St Julians
Print_ISBN :
978-1-4244-1687-5
Electronic_ISBN :
978-1-4244-1688-2
DOI :
10.1109/ISCCSP.2008.4537326