DocumentCode
402874
Title
Parallel mining association rules with bit string array in large database
Author
Meng, Xiang-ping ; Qian, Jin ; Qi, Xin
Author_Institution
Dept. of Electr. Eng., Changchun Inst. of Technol., China
Volume
1
fYear
2003
fDate
2-5 Nov. 2003
Firstpage
183
Abstract
Association rule mining is one of the important data mining tasks. However, the previously proposed methods still encounter some problems, such as complex data structure, candidate set generation, and so on. To improve efficiency, association rules can be mined in parallel. In this paper, we use a simpler data structure called bit string array and propose a new approach to apply parallel projection and compress technique in parallel mining association rules. It conducts various operations on bit string array according to the frequency of frequent items. For frequent item with less frequency, we conduct set operation on them; for frequent item with more frequency, we adopt compress technique and conduct bit AND operator on them. Moreover, it will reduce the communication cost and also response time. This method can be scaled up to very large databases by parallel projection and compress technique.
Keywords
data mining; database management systems; parallel databases; bit string array; compress technique; conduct bit AND operator; data mining; parallel mining association rules; parallel projection; Association rules; Costs; Data engineering; Data mining; Data structures; Databases; Delay; Frequency; Itemsets; Power engineering and energy;
fLanguage
English
Publisher
ieee
Conference_Titel
Machine Learning and Cybernetics, 2003 International Conference on
Print_ISBN
0-7803-8131-9
Type
conf
DOI
10.1109/ICMLC.2003.1264467
Filename
1264467
Link To Document