• DocumentCode
    1765455
  • Title

    On the Convergence of the IRLS Algorithm in Non-Local Patch Regression

  • Author

    Chaudhury, K.N.

  • Author_Institution
    Program in Appl. & Comput. Math. (PACM), Princeton Univ., Princeton, NJ, USA
  • Volume
    20
  • Issue
    8
  • fYear
    2013
  • fDate
    Aug. 2013
  • Firstpage
    815
  • Lastpage
    818
  • Abstract
    Recently, it was demonstrated in , that the robustness of the classical Non-Local Means (NLM) algorithm can be improved by incorporating lp (0 <; p ≤ 2) regression into the NLM framework. This general optimization framework, called Non-Local Patch Regression (NLPR), contains NLM as a special case. Denoising results on synthetic and natural images show that NLPR consistently performs better than NLM beyond a moderate noise level, and significantly so when p is close to zero. An iteratively reweighted least-squares (IRLS) algorithm was proposed for solving the regression problem in NLPR, where the NLM output was used to initialize the iterations. Based on exhaustive numerical experiments, we observe that the IRLS algorithm is globally convergent (for arbitrary initialization) in the convex regime 1 ≤ p ≤ 2, and locally convergent (e.g., fails rarely using NLM initialization) in the non-convex regime 0 <; p <; 1. In this letter, we study the cost associated with the IRLS updates, and this, along with the framework of bounded optimization, is used to analyze the convergence of the algorithm.
  • Keywords
    concave programming; image denoising; iterative methods; least squares approximations; regression analysis; IRLS algorithm; IRLS algorithm convergence; NLM framework; NLPR; bounded optimization; globally convergent; image denoising; iteratively reweighted least-square algorithm; locally convergent; nonconvex regime; nonlocal mean algorithm; nonlocal patch regression; regression problem; Algorithm design and analysis; Convergence; Newton method; Noise reduction; Optimization; Robustness; Signal processing algorithms; $ell^p$ minimization; Iteratively reweighted least-squares; linear convergence; majorize-minimize; non-convex optimization; non-local means; non-local patch regression;
  • fLanguage
    English
  • Journal_Title
    Signal Processing Letters, IEEE
  • Publisher
    ieee
  • ISSN
    1070-9908
  • Type

    jour

  • DOI
    10.1109/LSP.2013.2268248
  • Filename
    6530688