Title :
An Efficient and Scalable Implementation of Sliding-Window Aggregate Operator on FPGA
Author :
Oge, Yasin ; Yoshimi, Masato ; Miyoshi, Takanori ; Kawashima, Hitoshi ; Irie, Hidetsugu ; Yoshinaga, Tsunehiro
Author_Institution :
Grad. Sch. of Inf. Syst., Univ. of Electro-Commun., Chofu, Japan
Abstract :
This paper presents an efficient and scalable implementation of an FPGA-based accelerator for sliding-window aggregates over disordered data streams. With an increasing number of overlapping sliding-windows, the window aggregates have a serious scalability issue, especially when it comes to implementing them in parallel processing hardware (e.g., FPGAs). To address the issue, we propose a resource-efficient, scalable, and order-agnostic hardware design and its implementation by examining and integrating two key concepts, called Window-ID and Pane, which are originally proposed for software implementation, respectively. Evaluation results show that the proposed implementation scales well compared to the previous FPGA implementation in terms of both resource consumption and performance. The proposed design is fully pipelined and our implementation can process out-of-order data items, or tuples, at wire speed up to 200 million tuples per second.
Keywords :
field programmable gate arrays; parallel processing; FPGA-based accelerator; Pane; Window-ID; disordered data streams; order-agnostic hardware design; overlapping sliding windows; parallel processing hardware; resource consumption; sliding window aggregate operator; Aggregates; Equations; Field programmable gate arrays; Hardware; Mathematical model; Out of order; Scalability; FPGA; aggregation; data stream processing; disordered data; sliding window; stream punctuation;
Conference_Titel :
Computing and Networking (CANDAR), 2013 First International Symposium on
Conference_Location :
Matsuyama
Print_ISBN :
978-1-4799-2795-1
DOI :
10.1109/CANDAR.2013.23