DocumentCode :
2203643
Title :
A Triggering and Scheduling Approach for ETL in a Real-time Data Warehouse
Author :
Song, Jie ; Bao, Yubin ; Shi, Jingang
Author_Institution :
Northeastern Univ., Shenyang, China
fYear :
2010
fDate :
June 29 2010-July 1 2010
Firstpage :
91
Lastpage :
98
Abstract :
In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and In a real-time data warehouses, ETL is no longer executed periodically during the idle time of data warehouses, but continuously ongoing. Thus the triggering of ETL task, and the scheduling of updates and queries become the key issues. This paper proposes an IBSA (Integration Based Scheduling Approach), including the triggering rule and algorithm for staring an ETL task, and a scheduling algorithm for balancing the queries and updates by threads controlling. We also proposed the framework of implementations. A series of experiments show that IBSA can adjust the running order of tasks reasonably and use the system resources effectively to provide the faster query response and higher real-time capability of ETL.
Keywords :
data warehouses; query processing; scheduling; ETL task; integration based scheduling approach; query response; real time data warehouse; triggering rule; Data warehouses; Instruction sets; Loading; Monitoring; Real time systems; Scheduling; Scheduling algorithm; ETL; Real-time data warehouse; Scheduling; Triggering;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer and Information Technology (CIT), 2010 IEEE 10th International Conference on
Conference_Location :
Bradford
Print_ISBN :
978-1-4244-7547-6
Type :
conf
DOI :
10.1109/CIT.2010.57
Filename :
5578436
Link To Document :
بازگشت