Title :
A Triggering and Scheduling Approach for ETL in a Real-time Data Warehouse
Author :
Song, Jie ; Bao, Yubin ; Shi, Jingang
Author_Institution :
Northeastern Univ., Shenyang, China
fDate :
June 29 2010-July 1 2010
Abstract :
In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and the scheduling of updates and queries become the key issues. This paper proposes an IBSA (Integration Based Scheduling Approach), including the triggering rule and algorithm for staring an ETL task, and a scheduling algorithm for balancing the queries and updates by threads controlling. We also proposed the framework of implementations. A series of experiments show that IBSA can adjust the running order of tasks reasonably and use the system resources effectively to provide the faster query response and higher real-time capability of ETL.
Keywords :
data warehouses; query processing; scheduling; ETL task; integration based scheduling approach; query response; real time data warehouse; triggering rule; Data warehouses; Instruction sets; Loading; Monitoring; Real time systems; Scheduling; Scheduling algorithm; ETL; Real-time data warehouse; Scheduling; Triggering;
Conference_Titel :
Computer and Information Technology (CIT), 2010 IEEE 10th International Conference on
Conference_Location :
Bradford
Print_ISBN :
978-1-4244-7547-6
DOI :
10.1109/CIT.2010.57