Title :
Universal piecewise linear least squares prediction
Author :
Luengo, David ; Kozat, Suleyman S. ; Singer, Andrew C.
Author_Institution :
Dept. de Teoria de la Senal y, Comunicaciones of Univ. Carlos III, Madrid, Spain
fDate :
27 June-2 July 2004
Abstract :
The problem of sequential prediction of real-valued sequences using piece-wise linear models under the square-error loss function is presented in this paper. In this context, we demonstrate a sequential algorithm for prediction whose accumulated squared error for every bounded sequence is asymptotically as small as that of the best fixed predictor for that sequence taken from the class of piecewise linear predictors. We also show that this predictor is optimal in certain settings in a particular min-max sense. This approach can also be applied to the class of piecewise constant predictors, for which a similar universal sequential algorithm can be derived with corresponding min-max optimality.
Keywords :
least squares approximations; minimax techniques; piecewise linear techniques; prediction theory; sequences; accumulated square-error loss function; bounded sequence; least squares prediction; min-max optimality; piecewise constant predictor; real-valued sequential prediction; universal piecewise linear models; universal sequential algorithm; Engineering profession; Least squares methods; Piecewise linear techniques; Prediction algorithms; Predictive models; Vectors;
Conference_Titel :
Information Theory, 2004. ISIT 2004. Proceedings. International Symposium on
Print_ISBN :
0-7803-8280-3
DOI :
10.1109/ISIT.2004.1365238