Title :
A Novel Parallel Algorithm for Frequent Itemset Mining of Incremental Dataset
Author :
Lijun Xu ; Yun Zhang
Author_Institution :
Inf. Sch., Shanghai Maritime Univ., Shanghai, China
Abstract :
Most Algorithms for frequent item set mining typically make the assumption that data is centralized or static. They may waste computational and I/O resources when the data is dynamic, and they impose excessive communication overhead when the data is distributed. As a result, the data mining process is harmed by slow response time. In this paper we propose a novel algorithm that uses overlapping data partitions and parallelizes the workload among machines efficiently. Experiments confirm that our algorithm results in excellent running time improvements.
Keywords :
data mining; parallel processing; I/O resources; communication overhead; computational resources; data distribution; dynamic data; frequent itemset mining; incremental dataset; overlapping data partitioning; parallel algorithm; response time; workload parallelization; Algorithm design and analysis; Association rules; Distributed databases; Heuristic algorithms; Itemsets; Partitioning algorithms; frequent itemset; incremental mining; parallel mining;
Conference_Titel :
Information Science and Control Engineering (ICISCE), 2015 2nd International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-4673-6849-0
DOI :
10.1109/ICISCE.2015.18