DocumentCode
3559044
Title
On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations
Author
Bruckstein, Alfred M. ; Elad, Michael ; Zibulevsky, Michael
Author_Institution
Dept. of Comput. Sci., Technion - Israel Inst. of Technol., Haifa
Volume
54
Issue
11
fYear
2008
Firstpage
4813
Lastpage
4820
Abstract
An underdetermined linear system of equations Ax = b with nonnegativity constraint x ges 0 is considered. It is shown that for matrices A with a row-span intersecting the positive orthant, if this problem admits a sufficiently sparse solution, it is necessarily unique. The bound on the required sparsity depends on a coherence property of the matrix A. This coherence measure can be improved by applying a conditioning stage on A, thereby strengthening the claimed result. The obtained uniqueness theorem relies on an extended theoretical analysis of the lscr0 - lscr1 equivalence developed here as well, considering a matrix A with arbitrary column norms, and an arbitrary monotone element-wise concave penalty replacing the lscr1-norm objective function. Finally, from a numerical point of view, a greedy algorithm-a variant of the matching pursuit-is presented, such that it is guaranteed to find this sparse solution. It is further shown how this algorithm can benefit from well-designed conditioning of A .
Keywords
greedy algorithms; signal processing; sparse matrices; coherence measure; greedy algorithm; linear equations; monotone element-wise concave penalty; nonnegative sparse solution; orthogonal matching pursuit; signal processing; sparse matrices; underdetermined linear system; Constraint theory; Equations; Greedy algorithms; Image processing; Image recognition; Linear systems; Matching pursuit algorithms; Pursuit algorithms; Signal processing; Sparse matrices; $ell _{1}$ ; Basis pursuit; greedy algorithm; linear system; positive orthant; sparse solution; uniqueness;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2008.929920
Filename
4655436
Link To Document