Title :
MRGIS: A MapReduce-Enabled High Performance Workflow System for GIS
Author :
Chen, Qichang ; Wang, Liqiang ; Shang, Zongbo
Author_Institution :
Dept. of Comput. Sci., Univ. of Wyoming, Laramie, WY, USA
Abstract :
The growth of data used by data-intensive computations, e.g. geographical information systems (GIS), has far outpaced the growth of the power of a single processor. The increasing demand of data-intensive applications calls for distributed computing. In this paper, we propose a high performance workflow system MRGIS, a parallel and distributed computing platform based on MapReduce clusters, to execute GIS applications efficiently. MRGIS consists of a design interface, a task scheduler, and a runtime support system. The design interface has two options: a GUI-based workflow designer and an API-based library for programming in Python. Given a GIS workflow, the scheduler analyzes data dependencies among tasks, then dispatches them to MapReduce clusters based on the current status of the system. Our experiment demonstrates that MRGIS can significantly improve the performance of GIS workflow execution.
Keywords :
application program interfaces; cartography; geographic information systems; graphical user interfaces; workflow management software; API-based library; GIS; GUI; Geographical Information Systems; MRGIS; MapReduce-enabled high performance workflow system; Python; data-intensive computations; distributed computing; Application software; Computer architecture; Concurrent computing; Distributed computing; Fault tolerance; Geographic Information Systems; Parallel processing; Parallel programming; Processor scheduling; Programming profession;
Conference_Titel :
eScience, 2008. eScience '08. IEEE Fourth International Conference on
Conference_Location :
Indianapolis, IN
Print_ISBN :
978-1-4244-3380-3
Electronic_ISBN :
978-0-7695-3535-7
DOI :
10.1109/eScience.2008.169
