DocumentCode :
688383
Title :
A MapReduce Computing Framework Based on GPU Cluster
Author :
Heng Gao ; Jie Tang ; Gangshan Wu
Author_Institution :
Dept. of Comput. Sci. & Technol., Nanjing Univ., Nanjing, China
fYear :
2013
fDate :
13-15 Nov. 2013
Firstpage :
1902
Lastpage :
1907
Abstract :
In recent years, GPU has become a power-efficient device for high performance computing and is widely used in highly parallel application. Its hierarchy of threads and memory has been proven successful for large scale multithread applications. However, how to efficiently program on GPU so as to fully utilize the computing power of GPUs is still a main problem for those potential users. We designed and implemented a new parallel GPU programming framework based on MapReduce. In our framework, a distributed file system (GlusterFS) was employed to store data distributely. The aim of the framework is to improve the efficiency, transparence and scalability of high performance computing on GPU clusters. The dynamic load balancing was taken into consideration more specifically. How typical tasks in oil industry are modified to fit into the framework was demonstrated. Prestack Kirchhoff time migration (PKTM) of seismic data was tested which achieved good acceleration performance.
Keywords :
distributed databases; graphics processing units; multi-threading; petroleum industry; resource allocation; seismology; GPU cluster; GPU memory; GlusterFS; MapReduce computing framework; PKTM; distributed data storage; distributed file system; dynamic load balancing; efficiency improvement; high-performance computing; highly-parallel application; large-scale multithread applications; oil industry; parallel GPU programming framework; power-efficient device; prestack Kirchhoff time migration; scalability improvement; seismic data; thread hierarchy; transparence improvement; Data processing; Graphics processing units; High performance computing; Load management; Mars; Parallel processing; Programming; GPU Cluster; Load Balancing; MapReduce; Seismic migration;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC), 2013 IEEE 10th International Conference on
Conference_Location :
Zhangjiajie
Type :
conf
DOI :
10.1109/HPCC.and.EUC.2013.273
Filename :
6832156
Link To Document :
بازگشت