Title :
Sparse non-negative solution of a linear system of equations is unique
Author :
Bruckstein, Alfred M. ; Elad, Michael ; Zibulevsky, Michael
Author_Institution :
Comput. Sci. Dept., Technion-Israel Inst. of Technol., Haifa
Abstract :
We consider an underdetermined linear system of equations Ax = b with non-negative entries of A and b, and the solution x being also required to be non-negative. We show that if there exists a sufficiently sparse solution to this problem, it is necessarily unique. Furthermore, we present a greedy algorithm - a variant of the matching pursuit - that is guaranteed to find this sparse solution. The result mentioned above is obtained by extending the existing theoretical analysis of the basis pursuit problem, i.e. min ||x||1 s.t. Ax = b, by studying conditions for perfect recovery of sparse enough solutions. Considering a matrix A with arbitrary column norms, and an arbitrary monotone element-wise concave penalty replacing the lscr1-norm objective function, we generalize known equivalence results, and use those to derive the above uniqueness claim.
Keywords :
greedy algorithms; matrix algebra; basis pursuit problem; greedy algorithm; linear system of equations; matching pursuit; monotone element-wise concave penalty lscr1-norm objective function; sparse nonnegative solution; Computer science; Equations; Greedy algorithms; Image processing; Lead; Linear systems; Matching pursuit algorithms; Pursuit algorithms; Signal processing; Sparse matrices;
Conference_Titel :
Communications, Control and Signal Processing, 2008. ISCCSP 2008. 3rd International Symposium on
Conference_Location :
St Julians
Print_ISBN :
978-1-4244-1687-5
Electronic_ISBN :
978-1-4244-1688-2
DOI :
10.1109/ISCCSP.2008.4537325