Title :
A lower bound on the performance of sequential prediction
Author :
Kozat, Suleyman S. ; Singer, Andrew C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Illinois Univ., Urbana, IL, USA
Abstract :
We consider the problem of sequential linear prediction of real-valued sequences under the square-error less function. For this problem, a prediction algorithm has been demonstrated whose accumulated squared prediction error, for every bounded sequence, is asymptotically as small as the best fixed linear predictor for that sequence, taken from the class of all linear predictors of a given order p. The redundancy, or excess prediction error above that of the best predictor for that sequence, is upper bounded by A2pln(n)/n, where n is the data length and the sequence is assumed to be bounded by some A. In this paper, we show that this predictor is optimal in a min-max sense, by deriving a corresponding lower bound, such that no sequential predictor can ever do better than a redundancy of A2pln(n)/n.
Keywords :
information theory; prediction theory; redundancy; sequences; excess prediction error; lower bound; real-valued sequences; redundancy; sequential linear prediction; square-error less function; Ear; Engineering profession; Prediction algorithms; Redundancy;
Conference_Titel :
Information Theory, 2002. Proceedings. 2002 IEEE International Symposium on
Print_ISBN :
0-7803-7501-7
DOI :
10.1109/ISIT.2002.1023419