DocumentCode
1765455
Title
On the Convergence of the IRLS Algorithm in Non-Local Patch Regression
Author
Chaudhury, K.N.
Author_Institution
Program in Appl. & Comput. Math. (PACM), Princeton Univ., Princeton, NJ, USA
Volume
20
Issue
8
fYear
2013
fDate
Aug. 2013
Firstpage
815
Lastpage
818
Abstract
Recently, it was demonstrated in , that the robustness of the classical Non-Local Means (NLM) algorithm can be improved by incorporating lp (0 <; p ≤ 2) regression into the NLM framework. This general optimization framework, called Non-Local Patch Regression (NLPR), contains NLM as a special case. Denoising results on synthetic and natural images show that NLPR consistently performs better than NLM beyond a moderate noise level, and significantly so when p is close to zero. An iteratively reweighted least-squares (IRLS) algorithm was proposed for solving the regression problem in NLPR, where the NLM output was used to initialize the iterations. Based on exhaustive numerical experiments, we observe that the IRLS algorithm is globally convergent (for arbitrary initialization) in the convex regime 1 ≤ p ≤ 2, and locally convergent (e.g., fails rarely using NLM initialization) in the non-convex regime 0 <; p <; 1. In this letter, we study the cost associated with the IRLS updates, and this, along with the framework of bounded optimization, is used to analyze the convergence of the algorithm.
Keywords
concave programming; image denoising; iterative methods; least squares approximations; regression analysis; IRLS algorithm; IRLS algorithm convergence; NLM framework; NLPR; bounded optimization; globally convergent; image denoising; iteratively reweighted least-square algorithm; locally convergent; nonconvex regime; nonlocal mean algorithm; nonlocal patch regression; regression problem; Algorithm design and analysis; Convergence; Newton method; Noise reduction; Optimization; Robustness; Signal processing algorithms; $ell^p$ minimization; Iteratively reweighted least-squares; linear convergence; majorize-minimize; non-convex optimization; non-local means; non-local patch regression;
fLanguage
English
Journal_Title
Signal Processing Letters, IEEE
Publisher
ieee
ISSN
1070-9908
Type
jour
DOI
10.1109/LSP.2013.2268248
Filename
6530688
Link To Document