Title :
A simulation study of heuristic node reordering for collective I/O
Author :
Kwangho Cha ; Sungho Kim
Author_Institution :
Div. of Supercomput., Korea Inst. of Sci. & Technol. Inf., Daejeon, South Korea
Abstract :
As the scale of parallel computing systems grows, the importance of collective I/O also increases because it provides the function of single file based parallel I/O. Collective I/O follows two-phase I/O scheme that consists of a data exchange phase and an I/O phase. The previous studies of collective I/O were usually related with improving the performance of each phase. Especially, Heuristic Node Reordering (HNR) is the technique to improve the data exchange performance where a different number of cores per node are used for a parallel application. In this study, we implement the HNR simulator and analyze the effectiveness of HNR under various cases. As a result, we find out the number of nodes, the maximum number of cores and the shape of I/O data array are the important factors related to improving the HNR performance.
Keywords :
message passing; parallel processing; HNR simulator; I/O data array; data exchange phase; heuristic node reordering; parallel computing systems; single file based parallel I/O; Arrays; Computational modeling; Data models; Degradation; Multicore processing; Shape; Simulation; Collective I/O; I/O Aggregator; MPI-IO; Parallel I/O; Two-phase I/O;
Conference_Titel :
Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), 2015 16th IEEE/ACIS International Conference on
Conference_Location :
Takamatsu
DOI :
10.1109/SNPD.2015.7176232