Title :
Wire-Speed Implementation of Sliding-Window Aggregate Operator over Out-of-Order Data Streams
Author :
Oge, Yasin ; Yoshimi, Masato ; Miyoshi, Takanori ; Kawashima, Hitoshi ; Irie, Hidetsugu ; Yoshinaga, Tsunehiro
Author_Institution :
Grad. Sch. of Inf. Syst., Univ. of Electro-Commun., Chofu, Japan
Abstract :
This paper shows the design and evaluation of an FPGA-based accelerator for sliding-window aggregation over data streams with out-of-order data arrival. We propose an order-agnostic hardware implementation technique for windowing operators based on a one-pass query evaluation strategy called Window-ID, which is originally proposed for software implementation. The proposed implementation succeeds to process out-of-order data items, or tuples, at wire speed due to the simultaneous evaluations of overlapping sliding-windows. In order to verify the effectiveness of the proposed approach, we have also implemented an experimental system as a case study. Our experiments demonstrate that the proposed accelerator with a network interface achieves an effective throughput around 760 Mbps or equivalently nearly 6 million tuples per second, by fully utilizing the available bandwidth of the network interface.
Keywords :
data analysis; field programmable gate arrays; integrated circuit design; network interfaces; query processing; wires (electric); FPGA-based accelerator design; FPGA-based accelerator evaluation; Window-ID; network interface bandwidth; one-pass query evaluation strategy; order-agnostic hardware implementation technique; out-of-order data arrival; out-of-order data streams; sliding-window aggregate operator; wire-speed implementation; Aggregates; Clocks; Field programmable gate arrays; Hardware; Out of order; Pipelines; Registers; FPGA; data stream processing; disordered data; sliding-window aggregates; stream punctuation;
Conference_Titel :
Embedded Multicore Socs (MCSoC), 2013 IEEE 7th International Symposium on
Conference_Location :
Tokyo
DOI :
10.1109/MCSoC.2013.23