A Real-Time Database Testbed and Performance Evaluation

A lot of real-time database (RTDB) research has been done to process transactions in a timely fashion using fresh data reflecting the current real world status. However, most existing RTDB work is based on simulations. Due to the absence of a publicly available RTDB testbed, it is very hard to evaluate real-time data management techniques in a realistic environment. To address the problem, we design and develop an initial version of a RTDB testbed, called Chronos, atop an open source database. We develop soft real-time database workloads that model online stock trades, providing several knobs to specify workloads for RTDB performance evaluation. In addition, we develop a QoS management scheme in Chronos to detect overload and reduce workloads, via admission control and adaptive temporal data updates, under overload. From the extensive experiments using the stock trading workloads developed in Chronos, we observe that adaptive updates can considerably improve the transaction timeliness. We also observe that admission control can only enhance the timeliness under severe overload, possibly causing underutilization problems for moderate workloads. Overall, we observe several results different from simulation-based work, warranting the need for RTDB performance evaluation in a real database system.