Title :
Compile-time techniques for data distribution in distributed memory machines
Author :
Ramanujam, J. ; Sadayappan, P.
Author_Institution :
Dept. of Electr. & Comput. Eng., Louisiana State Univ., Baton Rouge, LA, USA
fDate :
10/1/1991 12:00:00 AM
Abstract :
A solution to the problem of partitioning data for distributed memory machines is discussed. The solution uses a matrix notation to describe array accesses in fully parallel loops, which allows the derivation of sufficient conditions for communication-free partitioning (decomposition) of arrays. A series of examples that illustrate the effectiveness of the technique for linear references, the use of loop transformations in deriving the necessary data decompositions, and a formulation that aids in deriving heuristics for minimizing a communication when communication-free partitions are not feasible are presented
Keywords :
matrix algebra; parallel programming; program compilers; array accesses; communication-free partitioning; compile time; data decompositions; data distribution; data partitioning; distributed memory machines; heuristics; linear references; loop transformations; matrix notation; parallel loops; sufficient conditions; Costs; Data analysis; Hypercubes; Information science; Matrix decomposition; Pattern analysis; Program processors; Programming profession; Random access memory; Sufficient conditions;
Journal_Title :
Parallel and Distributed Systems, IEEE Transactions on