DocumentCode :
2338384
Title :
A subquadratic algorithm for cluster and outlier detection in massive metric data
Author :
Chávez, Edgar
Author_Institution :
Universidad Michoacana
fYear :
2001
fDate :
13-15 Nov. 2001
Firstpage :
46
Lastpage :
58
Abstract :
The problem of cluster and outlier detection is a classic problem of non-parametric statistics. In recent times the need for cluster analysis in massive multimedia data sets (terabytes of data sampled from a metric space) have demonstrated the need for solutions both in the sense of being capable of automatic clustering metric data and at reasonable speed. Since cluster properties involve the relationship between each pair of data set elements, a good clustering algorithm must examine (in principle) every distance pair and hence has quadratic complexity. An appealing trend to achieve subquadratic complexity is either a) to use an approximation for a classic clustering algorithm or b) to design a new algorithm for clustering. This paper presents a new clustering algorithm performing O(n1+α) distance computations (the operation ofleading complexity), with 0 ⩽ α ⩽ 1 a constant depending on the intrinsic dimension of the sample data. The algorithm can detect outliers in the sample data and, if desired, it can produce a hierarchical structure (a dendogram) pointing to clusters at different resolutions.
Keywords :
Algorithm design and analysis; Approximation algorithms; Clustering algorithms; Clustering methods; Databases; Extraterrestrial measurements; Inverse problems; Partitioning algorithms; Shape; Statistics;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
String Processing and Information Retrieval, 2001. SPIRE 2001. Proceedings.Eighth International Symposium on
Conference_Location :
Laguna de San Rafael, Chile
Print_ISBN :
0-7695-1192-9
Type :
conf
DOI :
10.1109/SPIRE.2001.989736
Filename :
989736
Link To Document :
بازگشت