Title :
Efficient sparse matrix-matrix multiplication on heterogeneous high performance systems
Author :
Siegel, Jakob ; Villa, Oreste ; Krishnamoorthy, Sriram ; Tumeo, Antonino ; Li, Xiaoming
Author_Institution :
Electr. & Comput. Eng., Univ. of Delaware, Newark, DE, USA
Abstract :
The efficient implementation of sparse matrix-matrix multiplications on high performance parallel machines poses several challenges: large size of input matrices, compressed representation, density of the output matrices, partitioning and load balancing of matrices that present parts with large differences in density and, thus, in computation times. In this paper we show how, starting from the requirements of such application, we developed a framework that allows its efficient implementation on heterogeneous clusters. We introduce a task based programming model and a runtime supported execution model which provides dynamic load balancing on clusters composed by CPUs and GPUs, allowing better utilization of the system while easing the handling of sparse matrices. The results show that our solution, which co-designs the application together with the programming model and the runtime system, is able to obtain significant speedups due to a more effective load balancing with respect to other programming approaches.
Keywords :
matrix multiplication; parallel machines; parallel programming; resource allocation; sparse matrices; task analysis; heterogeneous high performance systems; high performance parallel machines; load balancing; partitioning; sparse matrix-matrix multiplication; task based programming; Graphics processing unit; Load management; Load modeling; Programming; Runtime; Sparse matrices; Tiles;
Conference_Titel :
Cluster Computing Workshops and Posters (CLUSTER WORKSHOPS), 2010 IEEE International Conference on
Conference_Location :
Heraklion, Crete
Print_ISBN :
978-1-4244-8395-2
Electronic_ISBN :
978-1-4244-8397-6
DOI :
10.1109/CLUSTERWKSP.2010.5613109