Title :
Parallel solvers for dense linear systems for heterogeneous computational clusters
Author :
Reddy, Ravi ; Lastovetsky, Alexey ; Alonso, Pedro
Author_Institution :
Sch. of Comput. Sci. & Inf., Univ. Coll. Dublin, Dublin, Ireland
Abstract :
This paper describes the design and the implementation of parallel routines in the heterogeneous ScaLAPACK library that solve a dense system of linear equations. This library is written on top of HeteroMPI and ScaLAPACK whose building blocks, the de facto standard kernels for matrix and vector operations (BLAS and its parallel counterpart PBLAS) and message passing communication (BLACS), are optimized for heterogeneous computational clusters. We show that the efficiency of these parallel routines is due to the most important feature of the library, which is the automation of the difficult optimization tasks of parallel programming on heterogeneous computing clusters. They are the determination of the accurate values of the platform parameters such as the speeds of the processors and the latencies and bandwidths of the communication links connecting different pairs of processors, the optimal values of the algorithmic parameters such as the total number of processes, the 2D process grid arrangement and the efficient mapping of the processes executing the parallel algorithm to the executing nodes of the heterogeneous computing cluster. We describe this process of automation followed by presentation of experimental results on a local heterogeneous computing cluster demonstrating the efficiency of these solvers.
Keywords :
message passing; parallel programming; software libraries; workstation clusters; HeteroMPI; PBLAS; dense linear system; heterogeneous ScaLAPACK library; heterogeneous computational clusters; linear equation; matrix operation; message passing communication; parallel programming; parallel routines; parallel solver; vector operation; Automation; Communication standards; Concurrent computing; Equations; Kernel; Libraries; Linear systems; Message passing; Parallel programming; Vectors;
Conference_Titel :
Parallel & Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on
Conference_Location :
Rome
Print_ISBN :
978-1-4244-3751-1
Electronic_ISBN :
1530-2075
DOI :
10.1109/IPDPS.2009.5161163