Title :
Data Partitioning and Placement Schemes for Matrix Multiplications on a PIM Architecture
Author :
Cha, Jae C. ; Gupta, Sandeep K.
Author_Institution :
Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
Data intensive applications require massive data transfers between storage and processing units. VLSI scaling has increased the sizes of dynamic memories as well as speeds and capabilities of processing units to a point where, for many such applications, storage and computational processing capabilities are no longer the main limiting factors. Despite this fact, most current architectures fail to meet the performance requirements for such data intensive applications. In this paper, we describe a PIM architecture that harnesses the benefits of VLSI scaling to accelerate matrix operations that constitute the core of many data-intensive applications. We then present data partitioning and placement schemes that are efficient in terms of the computational complexities and internode communication cost. Such approaches are evaluated and analyzed under various computing environments. We also discuss on how to apply such partitioning and placement schemes to each matrix when chains of matrix operations are given as a task.
Keywords :
VLSI; computational complexity; multicast protocols; PIM architecture; VLSI; computational complexity; data intensive applications; data partitioning; internode communication cost; matrix multiplications; matrix operations; placement schemes; Acceleration; Computational complexity; Computer applications; Computer architecture; Costs; Distributed computing; Fabrication; Logic; Partitioning algorithms; Very large scale integration; Matrix Multiplications; PIM;
Conference_Titel :
Parallel and Distributed Computing, 2008. ISPDC '08. International Symposium on
Conference_Location :
Krakow
Print_ISBN :
978-0-7695-3472-5
DOI :
10.1109/ISPDC.2008.7