Title :
Generating Incremental ETL Processes Automatically
Author :
Zhang, Xufeng ; Sun, Weiwei ; Wang, Wei ; Feng, Yahui ; Shi, Baile
Author_Institution :
Dept. of Comput. & Inf. Technol., Fudan Univ., Shanghai
Abstract :
Incremental ETL processes are used for the incremental maintenance of data warehouses, which is generally designed by users with ETL tools. Using existing methods of incremental maintenance of materialized views for reference, we put forward an approach to generate an incremental ETL process automatically from the full ETL process in this paper. Existing researches are focused on the incremental maintenance of materialized views in such circumstances which involve the operators of selection, projection, join and aggregation but difference operators excluded. Since difference operators are used frequently in an ETL process, we first discuss incremental maintenance of materialized views defined with difference operators in detail
Keywords :
data warehouses; ETL tools; aggregation operator; automatic incremental ETL process generation; data warehouses; difference operator; incremental maintenance; join operator; materialized views; projection operator; selection operator; Cost function; Data mining; Data warehouses; Information analysis; Information technology; Process design; Relational databases; Sun;
Conference_Titel :
Computer and Computational Sciences, 2006. IMSCCS '06. First International Multi-Symposiums on
Conference_Location :
Hanzhou, Zhejiang
Print_ISBN :
0-7695-2581-4
DOI :
10.1109/IMSCCS.2006.229
