Title :
Diffusion Sparse Least-Mean Squares Over Networks
Author :
Ying Liu ; Chunguang Li ; Zhaoyang Zhang
Author_Institution :
Dept. of Inf. Sci. & Electron. Eng., Zhejiang Univ., Hangzhou, China
Abstract :
We address the problem of in-network distributed estimation for sparse vectors. In order to exploit the underlying sparsity of the vector of interest, we incorporate the ℓ1- and ℓ0-norm constraints into the cost function of the standard diffusion least-mean squares (LMS). This technique is equivalent to adding a zero-attracting term in the iteration of the LMS-based algorithm, which accelerates the convergence rates of the zero or near-zero components. The rules for selecting the intensity of the zero-attracting term are derived and verified. Simulation results show that the performances of the proposed schemes depend on the degree of sparsity. Provided that suitable intensities of the zero-attracting term are selected, they can outperform the standard diffusion LMS when the considered vector is sparse. In addition, a practical application of the proposed sparse algorithms in spectrum estimation for a narrow-band source is presented.
Keywords :
least mean squares methods; vectors; ℓ0-norm constraint; ℓ1-norm constraint; convergence rates; cost function; diffusion sparse least-mean squares; in-network distributed estimation; narrow-band source; sparse vector; spectrum estimation; standard diffusion LMS; zero-attracting term; Estimation; Least squares approximation; Signal processing algorithms; Stability analysis; Steady-state; Upper bound; Vectors; Diffusion algorithm; distributed estimation; least mean squares (LMS); norm constraint; sparsity;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2012.2198468