Title :
MapReduce as a programming model for association rules algorithm on Hadoop
Author :
Yang, Xin Yue ; Liu, Zhen ; Fu, Yan
Author_Institution :
Dept. of Comput. Sci. & Eng., Univ. of Electron. Sci. & Technol. of China, Chengdu, China
Abstract :
As association rules widely used, it needs to study many problems, one of which is the generally larger and multi-dimensional datasets, and the rapid growth of the mount of data. Single-processor´s memory and CPU resources are very limited, which makes the algorithm performance inefficient. Recently the development of network and distributed technology makes cloud computing a reality in the implementation of association rules algorithm. In this paper we describe the improved Apriori algorithm based on MapReduce mode, which can handle massive datasets with a large number of nodes on Hadoop platform.
Keywords :
Association rules; Cloud computing; Computer science; Data engineering; Data mining; Electronic mail; Industrial relations; Itemsets; Machine learning algorithms; Transaction databases; Apriori; Association rules; Hadoop; KDD; MapReduce;
Conference_Titel :
Information Sciences and Interaction Sciences (ICIS), 2010 3rd International Conference on
Conference_Location :
Chengdu, China
Print_ISBN :
978-1-4244-7384-7
Electronic_ISBN :
978-1-4244-7386-1
DOI :
10.1109/ICICIS.2010.5534718