Title :
An Efficient Join Query Processing Based on MJR Framework
Author :
Chen, Shih-Ying ; Chen, Po-Chun
Author_Institution :
Dept. of Comput. Sci. & Inf. Eng., Nat. Taichung Univ. of Sci. & Technol., Taichung, Taiwan
Abstract :
Large data analysis is an important topic in cloud computing. Large-scale data analysis requires complex data analysis, such as Theta-Join, which includes equi-join and nonequi-join. On the other hand, MapReduce is a programming framework in cloud computing to compute data analysis in parallel. In order to improve MapRduce performance in complex data analysis, researchers propose the Map-Join-Reduce API to support the equi-join operation. The proposed method not only extends the Map-Join-Reduce framework but also supports nonequi-join. We propose three concepts. First data are filtered first according to the query statements. Second, the filtered data are sent to its corresponding worker according to the join expression for higher level parallelism. Each worker then performs the corresponding join operation after receiving the filtered data. Finally, we aggregate the result by using aggregate functions specified in the select clause.
Keywords :
application program interfaces; cloud computing; data analysis; information filtering; parallel programming; query processing; API; MJR; MapReduce; cloud computing; data analysis; data filtering; equi-join operation; map-join-reduce; nonequi-join; parallel computing; query processing; Aggregates; Cloud computing; Data analysis; Data communication; Filtering; Filtering algorithms; Silicon; MJR framework; MapReduce; cloud computing; join processing; large scale data;
Conference_Titel :
Software Engineering, Artificial Intelligence, Networking and Parallel & Distributed Computing (SNPD), 2012 13th ACIS International Conference on
Conference_Location :
Kyoto
Print_ISBN :
978-1-4673-2120-4
DOI :
10.1109/SNPD.2012.85