Title :
Lowering the complexity of k-means clustering by BFS-dijkstra method for graph computing
Author :
Zhang, Anna ; Jun Yao ; Nakashima, Yasuhiko
Author_Institution :
Grad. Sch. of Inf. Sci., Nara Inst. of Sci. & Technol., Ikoma, Japan
Abstract :
K-means is a method of vector quantization, which is now popularly used for clustering analysis in massive data mining. Due to its heavily computational-intensive feature for iteratively re-computing and sorting distances, the execution of k-means takes a huge amount of time, especially when processing large graph data such as the practical social networks. This paper studies an alternative method to emulate the k-clustering from another view, in which the vertices in a graph are partitioned into k farthest clusters. This method can be implementable in a breadth-first-search (BFS) form and then becomes easily parallelizable. Our result shows that our BFS-based k-clustering achieves more than 100x speeds than the traditional partitioning in the open-source graphlab project.
Keywords :
data mining; graph theory; mathematics computing; pattern clustering; tree searching; vector quantisation; BFS-Dijkstra method; breadth-first-search; data mining; graph computing; k-means clustering; vector quantization; Acceleration; Complexity theory; Facebook; Instruction sets; Kernel; Parallel processing; Topology;
Conference_Titel :
Low-Power and High-Speed Chips (COOL CHIPS XVIII), 2015 IEEE Symposium in
Conference_Location :
Yokohama
DOI :
10.1109/CoolChips.2015.7158653