Title :
The case for GPGPU spatial multitasking
Author :
Adriaens, Jacob T. ; Compton, Katherine ; Kim, Nam Sung ; Schulte, Michael J.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Wisconsin - Madison, Madison, WI, USA
Abstract :
The set-top and portable device market continues to grow, as does the demand for more performance under increasing cost, power, and thermal constraints. The integration of Graphics Processing Units (GPUs) into these devices and the emergence of general-purpose computations on graphics hardware enable a new set of highly parallel applications. In this paper, we propose and make the case for a GPU multitasking technique called spatial multitasking. Traditional GPU multitasking techniques, such as cooperative and preemptive multitasking, partition GPU time among applications, while spatial multitasking allows GPU resources to be partitioned among multiple applications simultaneously. We demonstrate the potential benefits of spatial multitasking with an analysis and characterization of General-Purpose GPU (GPGPU) applications. We find that many GPGPU applications fail to utilize available GPU resources fully, which suggests the potential for significant performance benefits using spatial multitasking instead of, or in combination with, preemptive or cooperative multitasking. We then implement spatial multitasking and compare it to cooperative multitasking using simulation. We evaluate several heuristics for partitioning GPU stream multiprocessors (SMs) among applications and find spatial multitasking shows an average speedup of up to 1.19 over cooperative multitasking when two applications are sharing the GPU. Speedups are even higher when more than two applications are sharing the GPU.
Keywords :
graphics processing units; multiprocessing systems; multiprogramming; GPGPU spatial multitasking technique; GPU stream multiprocessors; cooperative multitasking; general-purpose GPU application; general-purpose computations; graphics hardware; graphics processing units; portable device market; preemptive multitasking; set-top; Bandwidth; Encoding; Graphics processing unit; Instruction sets; Kernel; Multitasking; Transform coding;
Conference_Titel :
High Performance Computer Architecture (HPCA), 2012 IEEE 18th International Symposium on
Conference_Location :
New Orleans, LA
Print_ISBN :
978-1-4673-0827-4
Electronic_ISBN :
1530-0897
DOI :
10.1109/HPCA.2012.6168946