Title :
New ℌ∞ bounds for the recursive least squares algorithm exploiting input structure
Author :
Crammer, Koby ; Kulesza, Alex ; Dredze, Mark
Author_Institution :
Dept. of Electr. Enginering, Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
The recursive least squares (RLS) algorithm is well known and has been widely used for many years. Most analyses of RLS have assumed statistical properties of the data or the noise process, but recent robust ℌ∞ analyses have been used to bound the ratio of the performance of the algorithm to the total noise. In this paper, we provide an additive analysis bounding the difference between performance and noise. Our analysis provides additional convergence guarantees in general, and particular benefits for structured input data. We illustrate the analysis using human speech and white noise.
Keywords :
least squares approximations; statistical analysis; H∞ bounds; additive analysis; convergence guarantees; human speech; input structure; noise process; recursive least squares algorithm; statistical properties; white noise; Additives; Algorithm design and analysis; Learning systems; Noise; Prediction algorithms; Signal processing algorithms; Speech; Adaptive estimation; Adaptive signal processing; Machine learning;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on
Conference_Location :
Kyoto
Print_ISBN :
978-1-4673-0045-2
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2012.6288304