DocumentCode
3321286
Title
Real Time Delta Extraction Based on Triggers to Support Data Warehousing
Author
Valencio, Carlos Roberto ; Marioto, Matheus Henrique ; Donega Zafalon, Geraldo Francisco ; Machado, Jose Marcio ; Momente, Julio Cesar
Author_Institution
Dept. de Cienc. de Comput. e Estatistica, Sao Paulo State Univ., São José do Rio Preto, Brazil
fYear
2013
fDate
16-18 Dec. 2013
Firstpage
293
Lastpage
297
Abstract
Nowadays large corporations require integrated data from diverse sources, leading to the use of data warehouse architectures for this purpose. To bypass problems related to the use of computational resources to process large volumes of data, an ETL (Extract, Transform and Load) technique with zero latency can be used, that works by constantly processing small data loads. Among the extraction techniques of the zero latency ETL are the use of logs, triggers, materialized views and timestamps. This paper proposes a structure capable of performing this task by means of triggers and a tool developed for the automatic generation of the SQL (Structured Query Language) code to create these trigger, besides showing its performance and comparing it to other techniques. Said method is relevant for the extraction of portions of selected information as it permits to combine conventional and real time ETL techniques.
Keywords
SQL; data warehouses; program compilers; ETL technique; automatic SQL code generation; data warehouse architectures; extract-transform-load technique; integrated data; real time delta extraction; small data load processing; structured query language; zero latency; Computer architecture; Data mining; Data warehouses; Databases; Real-time systems; Scalability; Warehousing; CDC (Change Data Capture); ETL (Extract; Transform and Load); automatic code generation; data warehouse; trigger;
fLanguage
English
Publisher
ieee
Conference_Titel
Parallel and Distributed Computing, Applications and Technologies (PDCAT), 2013 International Conference on
Conference_Location
Taipei
Print_ISBN
978-1-4799-2418-9
Type
conf
DOI
10.1109/PDCAT.2013.52
Filename
6904269
Link To Document