Title :
The Sampling Rate-Distortion Tradeoff for Sparsity Pattern Recovery in Compressed Sensing
Author :
Reeves, Galen ; Gastpar, Michael
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, CA, USA
fDate :
5/1/2012 12:00:00 AM
Abstract :
Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a vanishing fraction of errors is impossible if the measurement rate and the per-sample signal-to-noise ratio (SNR) are finite constants, independent of the vector length. In this paper, it is shown that recovery with an arbitrarily small but constant fraction of errors is, however, possible, and that in some cases computationally simple estimators are near-optimal. Bounds on the measurement rate needed to attain a desired fraction of errors are given in terms of the SNR and various key parameters of the unknown vector for several different recovery algorithms. The tightness of the bounds, in a scaling sense, as a function of the SNR and the fraction of errors, is established by comparison with existing information-theoretic necessary bounds. Near optimality is shown for a wide variety of practically motivated signal models.
Keywords :
compressed sensing; distortion; sampling methods; vectors; SNR; compressed sensing; noisy linear measurement; sampling rate-distortion tradeoff; signal-to-noise ratio; sparse vector; sparsity pattern recovery; Distortion measurement; Maximum likelihood detection; Maximum likelihood estimation; Noise measurement; Rate-distortion; Signal to noise ratio; Vectors; Compressed sensing; message passing algorithms; model selection; random matrix theory; sparsity; support recovery;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2184848