• DocumentCode
    1450211
  • Title

    Exponential Bounds Implying Construction of Compressed Sensing Matrices, Error-Correcting Codes, and Neighborly Polytopes by Random Sampling

  • Author

    Donoho, David L. ; Tanner, Jared

  • Author_Institution
    Dept. of Stat., Stanford Univ., Stanford, CA, USA
  • Volume
    56
  • Issue
    4
  • fYear
    2010
  • fDate
    4/1/2010 12:00:00 AM
  • Firstpage
    2002
  • Lastpage
    2016
  • Abstract
    In "Counting faces of randomly projected polytopes when the projection radically lowers dimension " the authors proved an asymptotic sampling theorem for sparse signals, showing that n random measurements permit to reconstruct an N-vector having k nonzeros provided n > 2 · k-log(N/n)(1 + o(1)) reconstruction uses ¿1 minimization. They also proved an asymptotic rate theorem, showing existence of real error-correcting codes for messages of length N which can correct all possible k-element error patterns using just n generalized checksum bits, where n > 2e · k log(N/n)(1 + o(1)) decoding uses ¿1 minimization. Both results require an asymptotic framework, with N growing large. For applications, on the other hand, we are concerned with specific triples k, n, N. We exhibit triples (k, n, N) for which Compressed Sensing Matrices and Real Error-Correcting Codes surely exist and can be obtained with high probability by random sampling. These derive from exponential bounds on the probability of drawing \´bad\´ matrices. The bounds give conditions effective at finite-N, and converging to the known sharp asymptotic conditions for large N. Compared to other finite-N bounds known to us, they are much stronger, and much more explicit. Our bounds derive from asymptotics in "Counting faces of randomly projected polytopes when the projection radically lowers dimension" counting the expected number of k-dimensional faces of the randomly projected simplex TN-1 and cross-polytope CN. We develop here finite-N bounds on the expected discrepancy between the number of k-faces of the projected polytope AQ and its generator Q, for Q = TN-1 and CN. Our bounds also imply existence of interesting geometric objects. Thus, we exhibit triples (k, n, N) for which polytopes with 2N vertices can be centrally k-neighborly.
  • Keywords
    error correction codes; matrix algebra; probability; signal sampling; asymptotic rate theorem; compressed sensing matrices; error correcting codes; exponential bounds; random sampling probability; sampling theorem; sparse signals; Compressed sensing; Decoding; Error correction codes; Linear programming; Mathematics; Sampling methods; Signal processing; Sparse matrices; Statistics; Vectors; $ell_1$-minimization; compressed sensing; error-correction by linear programming; neighborly polytopes; random matrices;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2010.2040892
  • Filename
    5437438