Title :
Bitmap techniques for optimizing decision support queries and association rule algorithms
Author :
Hu, Xiaohua ; Lin, T.Y. ; Louie, Eric
Author_Institution :
Coll. of Inf. Sci., Drexel Univ., Philadelphia, PA, USA
Abstract :
In this paper, we discuss some new bitmap techniques for optimizing decision support queries and association rule algorithm. We first show how to use a new type of predefined bitmap join index (prejoin_bitmap_index) to efficiently execute complex decision support queries with multiple outer join operations involved and push the outer join operations from the data flow level to the bitmap level and achieve significant performance gain. Then we discuss a bitmap based association rule algorithm. Our bitmap based association rule algorithm Bit-AssocRule doesn´t follow the generation-and-test strategy of a priori algorithm and adopts the divide-and-conquer strategy, thus avoids the time-consuming table scan to find and prune the item sets, all the operations of finding large item sets from the datasets are the fast bit operations. The experimental results show Bit-AssocRule is 2 to 3 orders of magnitude faster than a priori and a priori hybrid algorithms. Our results indicate that bitmap techniques can greatly improve the performance of decision support queries and association rule algorithm, and bitmap techniques are very promising for the decision support query optimization and data mining applications.
Keywords :
associative processing; data analysis; data mining; decision support systems; formal logic; indexing; query processing; Bit-AssocRule; DSS query; a priori algorithm; a priori hybrid algorithm; bitmap based association rule algorithm; bitmap join index; bitmap level; bitmap technique; data flow level; data mining application; dataset; decision support query optimization; divide-and-conquer strategy; fast bit operation; item set pruning; multiple outer join operation; performance gain; performance improvement; prejoin_bitmap_index; table scan; Association rules; Computer science; Data mining; Databases; Decision support systems; Delta modulation; Educational institutions; Itemsets; Performance gain; Query processing;
Conference_Titel :
Database Engineering and Applications Symposium, 2003. Proceedings. Seventh International
Print_ISBN :
0-7695-1981-4
DOI :
10.1109/IDEAS.2003.1214909