Title :
Efficient parallel I/O scheduling in the presence of data duplication
Author :
Liu, Pangfeng ; Wang, Da-Wei ; Wu, Jan-Jan
Author_Institution :
Dept. of Comput. Sci., Nat. Taiwan Univ., Taipei
Abstract :
We investigate the problem of scheduling parallel I/O operations on systems that provide data replication. The objective is to direct each compute node to access data from an I/O node where the data is duplicated, in such a way that requests for data are evenly distributed among I/O nodes. We identify a necessary and sufficient condition on whether the current data request pattern can be improved, in terms of the maximum number of data requests on any I/O node. We propose an augmenting path algorithm that examines this necessary and sufficient condition, and adjusts the current data request pattern accordingly. Using network flow technique, we show that the augmenting path algorithm finds an optimal assignment in O(nmlogn+n2Iog3/2n) time
Keywords :
computational complexity; data flow computing; network operating systems; optimisation; parallel programming; scheduling; augmenting path algorithm; computational complexity; data duplication; data request pattern; network flow technique; optimal assignment; parallel I/O scheduling; Bipartite graph; Computer science; Concurrent computing; Disk drives; File systems; Libraries; Parallel processing; Processor scheduling; Scheduling algorithm; Sufficient conditions;
Conference_Titel :
Parallel Processing, 2003. Proceedings. 2003 International Conference on
Conference_Location :
Kaohsiung
Print_ISBN :
0-7695-2017-0
DOI :
10.1109/ICPP.2003.1240585