DocumentCode :
3138590
Title :
Improving MapReduce energy efficiency for computation intensive workloads
Author :
Wirtz, Thomas ; Ge, Rong
Author_Institution :
Dept. of Math., Marquette Univ., Milwaukee, WI, USA
fYear :
2011
fDate :
25-28 July 2011
Firstpage :
1
Lastpage :
8
Abstract :
MapReduce is a programming model for data intensive computing on large-scale distributed systems. With its wide acceptance and deployment, improving the energy efficiency of MapReduce will lead to significant energy savings for data centers and computational grids. In this paper, we study the performance and energy efficiency of the Hadoop implementation of MapReduce under the context of energy-proportional computing. We consider how MapReduce efficiency varies with two runtime configurations: resource allocation that changes the number of available concurrent workers, and DVFS (Dynamic Voltage and Frequency Scaling) that adjusts the processor frequency based on the workloads´ computational needs. Our experimental results indicate significant energy savings can be achieved from judicious resource allocation and intelligent DVFS scheduling for computation intensive applications, though the level of improvements depends on both workload characteristic of the MapReduce application and the policy of resource and DVFS scheduling.
Keywords :
cloud computing; computer centres; energy conservation; grid computing; power aware computing; processor scheduling; resource allocation; Hadoop; MapReduce energy efficiency; computation intensive workloads; computational grids; data centers; data intensive computing; dynamic voltage and frequency scaling; energy savings; energy-proportional computing; intelligent DVFS scheduling; large-scale distributed systems; processor frequency; resource allocation; Benchmark testing; Energy efficiency; Measurement; Processor scheduling; Resource management; Servers;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Green Computing Conference and Workshops (IGCC), 2011 International
Conference_Location :
Orlando, FL
Print_ISBN :
978-1-4577-1222-7
Type :
conf
DOI :
10.1109/IGCC.2011.6008564
Filename :
6008564
Link To Document :
بازگشت