Title :
Integer Programming Based Heterogeneous CPU-GPU Cluster Scheduler for SLURM Resource Manager
Author :
Soner, Seren ; Özturan, Can
Author_Institution :
Dept. of Comput. Eng., Bogazici Univ., Istanbul, Turkey
Abstract :
We present an integer programming based heterogeneous CPU-GPU cluster scheduler for the widely used SLURM resource manager. Our scheduler algorithm takes windows of jobs and solves an allocation problem in which free CPU cores and GPU cards are allocated collectively to jobs so as to maximize some objective function. We perform realistic SLURM emulation tests using the Effective System Performance (ESP) workloads. The test results show that our scheduler produces better resource utilization and shorter average job waiting times. The SLURM scheduler plug-in that implements our algorithm is available at http://code.google.com/p/slurm-ipsched/.
Keywords :
graphics processing units; integer programming; multiprocessing systems; pattern clustering; processor scheduling; resource allocation; ESP workloads; GPU cards; SLURM resource manager; effective system performance; free CPU cores; integer programming-based heterogeneous CPU-GPU cluster scheduler; job waiting times; objective function; resource utilization; Emulation; Graphics processing unit; IP networks; Licenses; Linear programming; Resource management; Supercomputers; SLURM; integer programming; scheduling;
Conference_Titel :
High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems (HPCC-ICESS), 2012 IEEE 14th International Conference on
Conference_Location :
Liverpool
Print_ISBN :
978-1-4673-2164-8
DOI :
10.1109/HPCC.2012.63