Generating Incremental ETL Processes Automatically

Author

Zhang, Xufeng ; Sun, Weiwei ; Wang, Wei ; Feng, Yahui ; Shi, Baile

Author_Institution

Dept. of Comput. & Inf. Technol., Fudan Univ., Shanghai

Volume

2

fYear

2006

fDate

20-24 June 2006

Firstpage

516

Lastpage

521

Abstract

Incremental ETL processes are used for the incremental maintenance of data warehouses, which is generally designed by users with ETL tools. Using existing methods of incremental maintenance of materialized views for reference, we put forward an approach to generate an incremental ETL process automatically from the full ETL process in this paper. Existing researches are focused on the incremental maintenance of materialized views in such circumstances which involve the operators of selection, projection, join and aggregation but difference operators excluded. Since difference operators are used frequently in an ETL process, we first discuss incremental maintenance of materialized views defined with difference operators in detail

Keywords

data warehouses; ETL tools; aggregation operator; automatic incremental ETL process generation; data warehouses; difference operator; incremental maintenance; join operator; materialized views; projection operator; selection operator; Cost function; Data mining; Data warehouses; Information analysis; Information technology; Process design; Relational databases; Sun;

fLanguage

English

Publisher

ieee

Conference_Titel

Computer and Computational Sciences, 2006. IMSCCS '06. First International Multi-Symposiums on

Conference_Location

Hanzhou, Zhejiang

Print_ISBN

0-7695-2581-4

Type

conf

DOI

10.1109/IMSCCS.2006.229

Filename

4673758