Distributed MapReduce framework using distributed hash table

Author

Chuan-Feng Chiu ; Hsu, Steen J. ; Sen-Ren Jan

Author_Institution

Dept. of Inf. Manage., Minghsin Univ. of Sci. & Technol., Hsinchu, Taiwan

fYear

2013

fDate

2-4 Nov. 2013

Firstpage

475

Lastpage

481

Abstract

In past years, Cloud computing is gained more attention in industry and academic area. The advance technologies are needed to match the demand of the development of cloud computing. MapReduce is one of the enabling technology. MapReduce is a programming model supporting parallel computation especially for data-intensive cloud computing applications. However, MapReduce needs a master node to coordinate the execution of the parallel computation. This may cause communication bottleneck and single point of failure error. Therefore, in this paper we propose a distributed MapReduce framework based on Distributed Hash Tables to support large scale cloud computing applications.

Keywords

cloud computing; file organisation; parallel programming; communication bottleneck; data-intensive cloud computing applications; distributed MapReduce framework; distributed hash table; parallel computation; programming model; Cloud computing; Monitoring; Overlay networks; Peer-to-peer computing; Programming; Routing; Distributed Hash Tables; MapReduce; cloud computing;

fLanguage

English

Publisher

ieee

Conference_Titel

Awareness Science and Technology and Ubi-Media Computing (iCAST-UMEDIA), 2013 International Joint Conference on

Conference_Location

Aizuwakamatsu

Type

conf

DOI

10.1109/ICAwST.2013.6765487

Filename

6765487