• DocumentCode
    1754509
  • Title

    An Empirical-Bayes Approach to Recovering Linearly Constrained Non-Negative Sparse Signals

  • Author

    Vila, Jeremy P. ; Schniter, Philip

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Ohio State Univ., Columbus, OH, USA
  • Volume
    62
  • Issue
    18
  • fYear
    2014
  • fDate
    Sept.15, 2014
  • Firstpage
    4689
  • Lastpage
    4703
  • Abstract
    We propose two novel approaches for the recovery of an (approximately) sparse signal from noisy linear measurements in the case that the signal is a priori known to be non-negative and obey given linear equality constraints, such as a simplex signal. This problem arises in, e.g., hyperspectral imaging, portfolio optimization, density estimation, and certain cases of compressive imaging. Our first approach solves a linearly constrained non-negative version of LASSO using the max-sum version of the generalized approximate message passing (GAMP) algorithm, where we consider both quadratic and absolute loss, and where we propose a novel approach to tuning the LASSO regularization parameter via the expectation maximization (EM) algorithm. Our second approach is based on the sum-product version of the GAMP algorithm, where we propose the use of a Bernoulli non-negative Gaussian-mixture signal prior and a Laplacian likelihood and propose an EM-based approach to learning the underlying statistical parameters. In both approaches, the linear equality constraints are enforced by augmenting GAMP´s generalized-linear observation model with noiseless pseudo-measurements. Extensive numerical experiments demonstrate the state-of-the-art performance of our proposed approaches.
  • Keywords
    Gaussian processes; compressed sensing; expectation-maximisation algorithm; message passing; mixture models; sparse matrices; Bernoulli nonnegative Gaussian-mixture signal prior; EM-based approach; GAMP algorithm; GAMP generalized-linear observation model; LASSO regularization parameter; Laplacian likelihood; compressive imaging; density estimation; expectation maximization algorithm; generalized approximate message passing algorithm; hyperspectral imaging; linear equality constraints; linearly constrained nonnegative sparse signals; noiseless pseudo-measurements; noisy linear measurements; portfolio optimization; sparse signal recovery; statistical parameters; sum-product version; AWGN; Approximation algorithms; Approximation methods; Optimization; Signal processing algorithms; Vectors; Belief propagation; compressed sensing; estimation; expectation maximization algorithms;
  • fLanguage
    English
  • Journal_Title
    Signal Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1053-587X
  • Type

    jour

  • DOI
    10.1109/TSP.2014.2337841
  • Filename
    6851882