DocumentCode
2589583
Title
K-Means Clustering with Bagging and MapReduce
Author
Li, Hai-Guang ; Wu, Gong-Qing ; Hu, Xue-Gang ; Zhang, Jing ; Li, Lian ; Wu, Xindong
Author_Institution
Sch. of Comput. Sci. & Inf. Eng., Hefei Univ. of Technol., Hefei, China
fYear
2011
fDate
4-7 Jan. 2011
Firstpage
1
Lastpage
8
Abstract
Clustering is one of the most widely used techniques for exploratory data analysis. Across all disciplines, from social sciences over biology to computer science, people try to get a first intuition about their data by identifying meaningful groups among the data objects. K-means is one of the most famous clustering algorithms. Its simplicity and speed allow it to run on large data sets. However, it also has several drawbacks. First, this algorithm is instable and sensitive to outliers. Second, its performance will be inefficient when dealing with large data sets. In this paper, a method is proposed to solve those problems, which uses an ensemble learning method bagging to overcome the instability and sensitivity to outliers, while using a distributed computing framework MapReduce to solve the inefficiency problem in clustering on large data sets. Extensive experiments have been performed to show that our approach is efficient.
Keywords
bagging; data analysis; distributed processing; pattern clustering; K-means clustering algorithm; MapReduce; computer science; data analysis; data object; data set; distributed computing; ensemble learning method bagging; social sciences; Algorithm design and analysis; Bagging; Clustering algorithms; Computer science; Machine learning algorithms; Merging; Training;
fLanguage
English
Publisher
ieee
Conference_Titel
System Sciences (HICSS), 2011 44th Hawaii International Conference on
Conference_Location
Kauai, HI
ISSN
1530-1605
Print_ISBN
978-1-4244-9618-1
Type
conf
DOI
10.1109/HICSS.2011.265
Filename
5718506
Link To Document