Title :
Failure time analysis for LMS algorithms
Author :
Zerai, Adel A. ; Bucklew, James A.
Author_Institution :
Electron. Eng. Dept., Coll. of Technol. Studies, Shuwaikh, Kuwait
fDate :
4/1/2002 12:00:00 AM
Abstract :
Few results are available in the literature on failure time (in contrast with long time average) analysis of the least mean square (LMS) adaptive algorithms (filters). Such analysis is extremely important when failure of the algorithm could cause failure of the entire system in which they are employed. A system may fail upon the first occurrence of a large error (any value far from 0), or upon staying far from 0 for a period of time (a clump of large errors). We use a Poisson approximation to study excursions (failure) of the LMS algorithm and its three signed variants. The distribution and the mean of the first excursion are approximated with the mean and distribution of an exponential distribution. The number of excursions in n units of time is approximated by a Poisson distribution. We also approximate the mean of an excursion length (clump size). The approximations are derived asymptotically as the excursion-defining set converges to the empty set, and as the algorithm step size converges to 0
Keywords :
Poisson distribution; adaptive filters; approximation theory; least mean squares methods; LMS algorithms; Poisson approximation; Poisson distribution; algorithm step size; clump size; empty set; error; excursion length; excursion-defining set; excursions; exponential distribution; failure time analysis; filters; least mean square adaptive algorithms; Adaptive algorithm; Adaptive filters; Algorithm design and analysis; Approximation algorithms; Exponential distribution; Failure analysis; Least squares approximation; Maximum likelihood detection; Shape; Signal processing algorithms;
Journal_Title :
Information Theory, IEEE Transactions on