Title :
A subquadratic algorithm for cluster and outlier detection in massive metric data
Author_Institution :
Universidad Michoacana
Abstract :
The problem of cluster and outlier detection is a classic problem of non-parametric statistics. In recent times the need for cluster analysis in massive multimedia data sets (terabytes of data sampled from a metric space) have demonstrated the need for solutions both in the sense of being capable of automatic clustering metric data and at reasonable speed. Since cluster properties involve the relationship between each pair of data set elements, a good clustering algorithm must examine (in principle) every distance pair and hence has quadratic complexity. An appealing trend to achieve subquadratic complexity is either a) to use an approximation for a classic clustering algorithm or b) to design a new algorithm for clustering. This paper presents a new clustering algorithm performing O(n1+α) distance computations (the operation ofleading complexity), with 0 ⩽ α ⩽ 1 a constant depending on the intrinsic dimension of the sample data. The algorithm can detect outliers in the sample data and, if desired, it can produce a hierarchical structure (a dendogram) pointing to clusters at different resolutions.
Keywords :
Algorithm design and analysis; Approximation algorithms; Clustering algorithms; Clustering methods; Databases; Extraterrestrial measurements; Inverse problems; Partitioning algorithms; Shape; Statistics;
Conference_Titel :
String Processing and Information Retrieval, 2001. SPIRE 2001. Proceedings.Eighth International Symposium on
Conference_Location :
Laguna de San Rafael, Chile
Print_ISBN :
0-7695-1192-9
DOI :
10.1109/SPIRE.2001.989736