Title :
The Effect of Cluster Size, Dimensionality, and the Number of Clusters on Recovery of True Cluster Structure
Author :
Milligan, Glenn W. ; Soon, S.C. ; Sokol, Lisa M.
Author_Institution :
Faculty of Management Sciences, Ohio State University, Columbus, OH 43210.
Abstract :
An evaluation of four clustering methods and four external criterion measures was conducted with respect to the effect of the number of clusters, dimensionality, and relative cluster sizes on the recovery of true cluster structure. The four methods were the single link, complete link, group average (UPGMA), and Ward´s minimum variance algorithms. The results indicated that the four criterion measures were generally consistent with each other, of which two highly similar pairs were identified. The tirst pair consisted of the Rand and corrected Rand statistics, and the second pair was the Jaccard and the Fowlkes and Mallows indexes. With respect to the methods, recovery was found to improve as the number of clusters increased and as the number of dimensions increased. The relative cluster size factor produced differential performance effects, with Ward´s procedure providing the best recovery when the clusters were of equal size. The group average method gave equivalent or better recovery when the clusters were of unequal size.
Keywords :
Algorithm design and analysis; Character generation; Clustering algorithms; Clustering methods; Error analysis; Extraterrestrial measurements; Helium; Monte Carlo methods; Size measurement; Statistics; Cluster recovery; Monte Carlo methods; clustering validation; error perturbation procedures; external criterion statistics;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.1983.4767342