Title :
Partial update LMS algorithms
Author :
Godavarti, Mahesh ; Hero, Alfred O., III
Author_Institution :
Ditech Commun. Inc., Mountain View, CA, USA
fDate :
7/1/2005 12:00:00 AM
Abstract :
Partial updating of LMS filter coefficients is an effective method for reducing computational load and power consumption in adaptive filter implementations. This paper presents an analysis of convergence of the class of Sequential Partial Update LMS algorithms (S-LMS) under various assumptions and shows that divergence can be prevented by scheduling coefficient updates at random, which we call the Stochastic Partial Update LMS algorithm (SPU-LMS). Specifically, under the standard independence assumptions, for wide sense stationary signals, the S-LMS algorithm converges in the mean if the step-size parameter μ is in the convergent range of ordinary LMS. Relaxing the independence assumption, it is shown that S-LMS and LMS algorithms have the same sufficient conditions for exponential stability. However, there exist nonstationary signals for which the existing algorithms, S-LMS included, are unstable and do not converge for any value of μ. On the other hand, under broad conditions, the SPU-LMS algorithm remains stable for nonstationary signals. Expressions for convergence rate and steady-state mean-square error of SPU-LMS are derived. The theoretical results of this paper are validated and compared by simulation through numerical examples.
Keywords :
adaptive filters; asymptotic stability; least mean squares methods; numerical stability; signal processing; stochastic processes; adaptive filter; convergence; exponential stability; max partial update; sequential partial update LMS algorithm; steady-state mean-square error; stochastic partial update LMS algorithm; Adaptive filters; Algorithm design and analysis; Convergence; Energy consumption; Least squares approximation; Processor scheduling; Scheduling algorithm; Stability; Stochastic processes; Sufficient conditions; Exponential stability; max partial update; partial update LMS algorithms; periodic algorithm; random updates; sequential algorithm; set-membership;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2005.849167