Data Load Distribution by Semi Real Time Data Warehouse

Author

Javed, Muhammad Younus ; Nawaz, Asim

Author_Institution

Coll. of Electr. & Mech. Eng., Nat. Univ. of Sci. & Technol., Rawalpindi, Pakistan

fYear

2010

fDate

23-25 April 2010

Firstpage

556

Lastpage

560

Abstract

Today many organizations used data warehouse for strategic decision making. Today´s real-time business stresses the potential to process increasingly volumes of data at very high speed in order to stay competitive in market. Data Warehouse is populated by data extraction, transformation and loading from different data sources by software utilities called ETL (Extraction, transformation & loading). ETL process is a time consuming process as it has to process large volume of data. ETL processes must have certain completion time window and ETL process must have to finish within this time window. In this paper we discusses a technique to distribute the volume of data to be extracted, transformed and loaded into data warehouse by merging both conventional and real-time techniques, so ETL process finishes its job within its time window by utilizing ETL idle time.

Keywords

business data processing; data warehouses; decision making; ETL process; data extraction; data load distribution; data loading; data transformation; semi real time data warehouse; software utilities; strategic decision making; Appropriate technology; Data mining; Data warehouses; Databases; Decision making; Educational institutions; Mechanical engineering; Real time systems; Stress; Warehousing;

fLanguage

English

Publisher

ieee

Conference_Titel

Computer and Network Technology (ICCNT), 2010 Second International Conference on

Conference_Location

Bangkok

Print_ISBN

978-0-7695-4042-9

Electronic_ISBN

978-1-4244-6962-8

Type

conf

DOI

10.1109/ICCNT.2010.104

Filename

5474438