An ETL Services Framework Based on Metadata

This paper first analyzed the problems of existing ETL tools, and proposed an ETL service model based on metadata, and then summarizes the types of metadata and their application scope. Based on this ETL service model, a concrete ETL service framework was put forward; many important services were also discussed, such as metadata management service, metadata definition services, ETL transformation rules service, process definition service, SQL code generation and optimization services, process control services and so on. At last, definition method and related algorithms of ETL rules are designed and analyzed. Practice has proved that the model and framework proposed in this paper can improve the ETL efficiency to a large extent.