Title :
One-pass wavelet decompositions of data streams
Author :
Gilbert, Anna C. ; Kotidis, Yannis ; Muthukrishnan, S. ; Strauss, Martin J.
Author_Institution :
AT&T Labs.-Res., USA
Abstract :
We present techniques for computing small space representations of massive data streams. These are inspired by traditional wavelet-based approximations that consist of specific linear projections of the underlying data. We present general "sketch"-based methods for capturing various linear projections and use them to provide pointwise and rangesum estimation of data streams. These methods use small amounts of space and per-item time while streaming through the data and provide accurate representation as our experiments with real data streams show.
Keywords :
data mining; data models; query processing; randomised algorithms; wavelet transforms; data streams; linear projections; massive data streams; one-pass wavelet decompositions; pointwise estimation; randomized algorithms; rangesum estimation; small space representations; wavelet-based approximations; Data mining; Data processing; Data structures; Databases; History; Monitoring; Switches; Telecommunication switching; Telecommunication traffic; Telephony;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2003.1198389