LMS is H∞ optimal

Shows that the celebrated LMS (least-mean squares) adaptive algorithm is an H^∞ optimal filter. In other words, the LMS algorithm, which has long been regarded as an approximate least-mean squares solution, is in fact a minimizer of the H^∞ error norm. In particular, the LMS minimizes the energy gain from the disturbances to the predicted errors, while the normalized LMS minimizes the energy gain from the disturbances to the filtered errors. Moreover, since these algorithms are central H^∞ filters, they are also risk-sensitive optimal and minimize a certain exponential cost function. The authors discuss various implications of these results, and show how they provide theoretical justification for the widely observed excellent robustness properties of the LMS filter