• DocumentCode
    1388532
  • Title

    Unbiased Estimation of a Sparse Vector in White Gaussian Noise

  • Author

    Jung, Alexander ; Ben-Haim, Zvika ; Hlawatsch, Franz ; Eldar, Yonina C.

  • Author_Institution
    Inst. of Telecommun., Vienna Univ. of Technol., Vienna, Austria
  • Volume
    57
  • Issue
    12
  • fYear
    2011
  • Firstpage
    7856
  • Lastpage
    7876
  • Abstract
    The problem studied in this paper is unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. It is shown that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance. Therefore, the focus is placed on locally minimum variance unbiased (LMVU) estimators. Simple closed-form lower and upper bounds on the variance of LMVU estimators or, equivalently, on the Barankin bound (BB) are derived. These bounds allow an estimation of the threshold region separating the low-signal-to-noise ratio (SNR) and high-SNR regimes, and they indicate the asymptotic behavior of the BB at high SNR. In addition, numerical lower and upper bounds are derived; these are tighter than the closed-form bounds and thus characterize the BB more accurately. Numerical studies compare the proposed characterizations of the BB with established biased estimation schemes, and demonstrate that while unbiased estimators perform poorly at low SNR, they may perform better than biased estimators at high SNR. An interesting conclusion of this analysis is that the high-SNR behavior of the BB depends solely on the value of the smallest nonzero entry of the sparse vector, and that this type of dependence is also exhibited by the performance of certain practical estimators.
  • Keywords
    AWGN; signal reconstruction; Barankin bound; LMVU estimators; additive white Gaussian noise; locally minimum variance unbiased; signal processing algorithms; signal reconstruction; signal-to-noise ratio; sparse nonrandom vector; sparse vector unbiased estimation; Gaussian noise; Maximum likelihood estimation; Signal to noise ratio; Upper bound; Barankin bound; Cramér–Rao bound; Hammersley–Chapman–Robbins bound; denoising; locally minimum variance unbiased estimator; sparsity; unbiased estimation;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2011.2170124
  • Filename
    6094285