Title :
Dynamic Load-Balancing and High Performance Communication in Jcluster
Author :
Zhang, Bao-Yin ; Mo, Ze-Yao ; Yang, Guang-Wen ; Zheng, Wei-Min
Author_Institution :
Inst. of Appl. Phys. & Comput. Math., Beijing
Abstract :
This paper describes the dynamic load-balancing and high performance communication provided in Jcluster, an efficient Java parallel environment. For the efficient load-balancing, we implement a task scheduler based on a transitive random stealing algorithm, which improves the random stealing, a well-known load-balancing algorithm. The experiment results show that the scheduler performs efficiently, especially for a large-scale cluster. With the method of asynchronously multithreaded transmission, a high performance PVM-like and MPI-like message passing interface is implemented in pure Java. The evaluation of the communication performance is conducted among Jcluster, LAM-MPI and mpiJava on LAM-MPI based on the Java Grande Forum´s pingpong benchmark.
Keywords :
message passing; resource allocation; scheduling; Java Grande Forum pingpong benchmark; Java parallel environment; Jcluster; LAM-MPI; dynamic load-balancing algorithm; high performance communication; message passing interface; mpiJava; multithreaded transmission; task scheduler; transitive random stealing algorithm; Clustering algorithms; Concurrent computing; High performance computing; Java; Large-scale systems; Load management; Message passing; Physics; Processor scheduling; Scheduling algorithm; Dynamic load balancing; asynchronously multithreaded transmission; large-scale heterogenous cluster; transitive random stealing;
Conference_Titel :
Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International
Conference_Location :
Rome
Print_ISBN :
1-4244-0909-8
Electronic_ISBN :
1-4244-0910-1
DOI :
10.1109/IPDPS.2007.370417