Title :
Research on Performance Optimization for Grid Application Using Distributed File System
Author :
Hu, Liang ; Lin, Lin ; Zhao, Jia
Author_Institution :
Dept. of Comput. Sci. & Technol., Jilin Univ., Changchun, China
Abstract :
Applications can be submitted as jobs in grid. Grid jobs usually comprise the scenarios of file stage-in, execution and file stage-out. These scenarios always run in batch mode. It leads to the waiting of the computational resource for data transfer and limits the performance of the grid application, especially when the application is data/communication intensive. Utilizing the file sharing function of distributed file system, the scenarios of grid job can be processed in parallel, while the waiting of computational resource can be eliminated. Thus, the execution performance of the grid job is promoted. After the comparison of different kinds of distributed file systems, this paper proposes CIFS-based mode for the data exchange in grid job, and testifies the promotion of the performance under this mode. In the test of a series of data/communication intensive jobs, the CIFS-based mode performs better performance than GridFTP.
Keywords :
electronic data interchange; grid computing; optimisation; peer-to-peer computing; CIFS; computational resource; data exchange; data transfer; distributed file system; execution; file sharing function; file stage-in; file stage-out; grid job; performance optimization; Distributed databases; File systems; Optimization; Peer to peer computing; Protocols; Servers; Storage area networks; CIFS; Data Exchange; Distributed File System; Grid Job; Optimization;
Conference_Titel :
Frontier of Computer Science and Technology (FCST), 2010 Fifth International Conference on
Conference_Location :
Changchun, Jilin Province
Print_ISBN :
978-1-4244-7779-1
DOI :
10.1109/FCST.2010.100