Title :
Architecture of geospatial big-data batch processing model based on Hadoop
Author :
Sang-Su Kim;Sung-Hwan Yu
Author_Institution :
IC Research Laboratory, ICTWAY Corporation, Dae-Jeon, Republic of Korea
Abstract :
In this paper, we propose a spatial ETL toolkit model, regardless of collectible data format, to replace traditional ETL (Extract, Transform, Load) to process public or individual system server with fast data creation. Recently various web servers, and the need of analyzing structured/unstructured Big-Data log information generated by independent high-speed servers are increasing. In addition, the space ETL model for replacing an existing service, which is built into a relational database is required and replaced the existing system in order to analyze unstructured data log information in Big-Data environments, where space is needed the ETL model. This paper proposes the spatial ETL model and proposed model is possible loading log information regardless of connected Hadoop or local storage to input data format quickly and accurately. Existing relational database consist of structured data is possible connection and extend function.
Keywords :
"Load modeling","Data models","Storms","Data mining","Loading","XML","Engines"
Conference_Titel :
Information and Communication Technology Convergence (ICTC), 2015 International Conference on
DOI :
10.1109/ICTC.2015.7354713