Title :
Data agnostic resource scheduling in the grid
Author :
Hayward, Geoffrey G. ; Lumb, L. Ian
Author_Institution :
Yotta Yotta Inc., Edmonton, Alta., Canada
Abstract :
Data grid architectures must confront the antipodal problems of data locality and global data coherence. Here, we examine a new approach to meeting these conflicting needs that leverages a storage wide area network, a clustered file system, a distributed block system, and a distributed resource scheduler. We examine multi-site concurrent I/O performance on an emulated three-site data grid with inter-site separations ranging from 1000 km-5000 km. We examine workloads that require all sites to interact with a single, globally coherent data image. In particular, all three sites perform concurrent write operations to shared files within a single file system.
Keywords :
data communication; distributed databases; grid computing; open systems; resource allocation; scheduling; clustered file system; concurrent I/O performance; data communication; data grid architecture; data locality; data processing; distributed block system; distributed database scheduling; global data coherence; resource management; storage wide area network; Bandwidth; Data processing; Delay; Distributed databases; File systems; Image databases; Intelligent networks; Network servers; Processor scheduling; Wide area networks; data communication; data processing; distributed database scheduling; resource management;
Conference_Titel :
High Performance Computing Systems and Applications, 2005. HPCS 2005. 19th International Symposium on
Print_ISBN :
0-7695-2343-9
DOI :
10.1109/HPCS.2005.23