Title :
A Parallel Bulk Loading Algorithm for M-tree on Multi-core CPUs
Author :
Qiu, Chu ; Lu, Yongquan ; Gao, Pengdong ; Wang, Jintao ; Lv, Rui
Author_Institution :
High Performance Comput. Center, Commun. Univ. of China, Beijing, China
Abstract :
A parallel bulk loading algorithm of M-tree is proposed in this paper, which takes advantage of the multi-core chips. The sequential bulk loading algorithm of M-tree consists of three steps: partition, recursion and aggregation, and we parallelize the first two steps. In the partition step, the whole dataset are split and assigned to several independent threads. Then, a tree-structure tasks graph is adopted to parallelize the second step recursion. The problems of load balancing and synchronization are both considered carefully in our algorithm. Experimental results have illustrated that the proposed parallel algorithm can speed up the procedure of bulk loading of M-tree significantly.
Keywords :
multiprocessing systems; parallel algorithms; resource allocation; tree data structures; M-tree; aggregation; load balancing; multicore CPU; multicore chip; parallel bulk loading algorithm; partition; recursion; second step recursion; synchronization; tree-structure tasks graph; Clustering algorithms; Concurrent computing; Costs; Extraterrestrial measurements; High performance computing; Multicore processing; Parallel processing; Partitioning algorithms; Tree graphs; Yarn; M-tree; bulk loading; multi-core; parallel;
Conference_Titel :
Computational Science and Optimization (CSO), 2010 Third International Joint Conference on
Conference_Location :
Huangshan
Print_ISBN :
978-1-4244-6812-6
Electronic_ISBN :
978-1-4244-6813-3
DOI :
10.1109/CSO.2010.96