Title :
A scalable complex event processing framework for combination of SQL-based continuous queries and C/C++ functions
Author :
Takenaka, Takashi ; Takagi, Masamichi ; Inoue, Hiroaki
Author_Institution :
NEC Corp., Kawasaki, Japan
Abstract :
SQL-based languages are widely used for Software-based Complex Event Processing (CEP) systems. This paper proposes a FPGA acceleration framework to compile a SQL-based event processing language, which is based on the ANSI standard proposal to support event processing, into a high-performance CEP engine on FPGAs. Besides the SQL´s primitives such as partitioning, windowing, aggregation and pattern matching, the proposed framework allows C/C++ functions to implement complex algorithms required by real-world applications. The CEP engine also scales very efficiently processing multiple streams in parallel by making use of inexpensive block memories. Experimental results show that our proposed CEP engine, which is compiled for a financial analysis application calculating a popular trading benchmark to capture meaningful market trends, achieves 150M events/sec (20Gbps) processing performance for over 16,000 streams.
Keywords :
C++ language; SQL; field programmable gate arrays; financial data processing; parallel processing; program compilers; query processing; software performance evaluation; ANSI standard; C functions; C++ functions; FPGA acceleration framework; SQL-based continuous queries; SQL-based event processing language compilation; SQL-based languages; financial analysis application; high-performance CEP engine; market trends; multiple streams processing; parallel processing; scalable complex event processing framework; software-based CEP systems; software-based complex event processing systems; trading benchmark; Benchmark testing; Context; Engines; Field programmable gate arrays; Pattern matching; Pipelines;
Conference_Titel :
Field Programmable Logic and Applications (FPL), 2012 22nd International Conference on
Conference_Location :
Oslo
Print_ISBN :
978-1-4673-2257-7
Electronic_ISBN :
978-1-4673-2255-3
DOI :
10.1109/FPL.2012.6339187