• DocumentCode
    3559044
  • Title

    On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations

  • Author

    Bruckstein, Alfred M. ; Elad, Michael ; Zibulevsky, Michael

  • Author_Institution
    Dept. of Comput. Sci., Technion - Israel Inst. of Technol., Haifa
  • Volume
    54
  • Issue
    11
  • fYear
    2008
  • Firstpage
    4813
  • Lastpage
    4820
  • Abstract
    An underdetermined linear system of equations Ax = b with nonnegativity constraint x ges 0 is considered. It is shown that for matrices A with a row-span intersecting the positive orthant, if this problem admits a sufficiently sparse solution, it is necessarily unique. The bound on the required sparsity depends on a coherence property of the matrix A. This coherence measure can be improved by applying a conditioning stage on A, thereby strengthening the claimed result. The obtained uniqueness theorem relies on an extended theoretical analysis of the lscr0 - lscr1 equivalence developed here as well, considering a matrix A with arbitrary column norms, and an arbitrary monotone element-wise concave penalty replacing the lscr1-norm objective function. Finally, from a numerical point of view, a greedy algorithm-a variant of the matching pursuit-is presented, such that it is guaranteed to find this sparse solution. It is further shown how this algorithm can benefit from well-designed conditioning of A .
  • Keywords
    greedy algorithms; signal processing; sparse matrices; coherence measure; greedy algorithm; linear equations; monotone element-wise concave penalty; nonnegative sparse solution; orthogonal matching pursuit; signal processing; sparse matrices; underdetermined linear system; Constraint theory; Equations; Greedy algorithms; Image processing; Image recognition; Linear systems; Matching pursuit algorithms; Pursuit algorithms; Signal processing; Sparse matrices; $ell _{1}$; Basis pursuit; greedy algorithm; linear system; positive orthant; sparse solution; uniqueness;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2008.929920
  • Filename
    4655436