Title :
Universal Piecewise Linear Regression of Individual Sequences: Lower Bound
Author :
Zeitler, Georg C. ; Singer, Andrew C. ; Kozat, Suleyman S.
Author_Institution :
Dept. of Electr. & Comput. Eng., Illinois Univ., Urbana, IL
Abstract :
We consider universal piecewise linear regression of real valued bounded sequences under the squared loss function. In this setting, we present a lower bound on the regret of a universal sequential piecewise linear regressor compared to the best piecewise linear regressor that has access to the entire sequence in advance. This lower bound is tight in that it achieves the corresponding upper bound, suggesting a minmax optimality of the sequential regressor, for every individual bounded sequence.
Keywords :
minimax techniques; piecewise linear techniques; signal processing; bounded sequence; minimax optimality; real valued bounded sequences; squared loss function; universal sequential piecewise linear regressor; Linear regression; Machine learning algorithms; Minimax techniques; Piecewise linear approximation; Piecewise linear techniques; Prediction algorithms; Prediction methods; Signal processing algorithms; Upper bound; Vectors; Regression; minimax methods; piecewise linear approximation; prediction methods; universal;
Conference_Titel :
Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on
Conference_Location :
Honolulu, HI
Print_ISBN :
1-4244-0727-3
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2007.366811