Title :
Fast Candidate Points Selection in the LASSO Path
Author :
Panahi, Ashkan ; Viberg, Mats
Author_Institution :
Dept. of Signals & Syst., Chalmers Univ., Gothenburg, Sweden
Abstract :
The LASSO sparse regression method has recently received attention in a variety of applications from image compression techniques to parameter estimation problems. This paper addresses the problem of regularization parameter selection in this method in a general case of complex-valued regressors and bases. Generally, this parameter controls the degree of sparsity or equivalently, the estimated model order. However, with the same sparsity/model order, the smallest regularization parameter is desired. We relate such points to the nonsmooth points in the path of LASSO solutions and give an analytical expression for them. Then, we introduce a numerically fast method of approximating the desired points by a recursive algorithm. The procedure decreases the necessary number of solutions of the LASSO problem dramatically, which is an important issue due to the polynomial computational cost of the convex optimization techniques. We illustrate our method in the context of DOA estimation.
Keywords :
convex programming; data compression; direction-of-arrival estimation; image coding; polynomials; regression analysis; DOA estimation; LASSO path; LASSO sparse regression; candidate points selection; complex-valued regressors; convex optimization; image compression; parameter estimation; polynomial computational cost; regularization parameter selection; Equations; Estimation; Indexes; Iterative methods; Manifolds; Optimization; Vectors; Homotopy; LARS; LASSO; linear regression; stagewise regression;
Journal_Title :
Signal Processing Letters, IEEE
DOI :
10.1109/LSP.2011.2179534