Title :
WINP: a window-based incremental and parallel clustering algorithm for very large databases
Author :
Qiang, Zhang ; Zheng, Zhao ; Wei, Sun Zhi ; Daley, Edward
Author_Institution :
Sch. of Electron. Inf. Eng., Tianjin Univ.
Abstract :
We introduce a new clustering algorithm called WINP for very large databases. Two different sizes of handling objects were used in WINP to acquire high accuracy and efficiency. WINP creates a window to detect approximate locations of clusters before accurate clustering processing. Clustering on these locations will reduce a lot of computations and get a good performance. WINP is the first algorithm to realize both incremental clustering and distributed parallel clustering. The advantages of our new approach are: (1) it is very efficient; (2) it realizes distributed parallel processing and can be run on a number of workstations connected via local area network; (3) it introduces a novel incremental clustering method for new coming data in an already processed database; (4) it is effective in discovering clusters of arbitrary shape; (5) it is not sensitive to noise; and (6) it has some ability to deal with high dimensional points
Keywords :
parallel processing; pattern clustering; very large databases; WINP; approximate location detection; cluster discovering; clustering processing; distributed parallel clustering; local area network; very large databases; window-based incremental clustering; Clustering algorithms; Clustering methods; Data engineering; Distributed databases; Local area networks; Noise shaping; Parallel processing; Shape; Sun; Workstations;
Conference_Titel :
Tools with Artificial Intelligence, 2005. ICTAI 05. 17th IEEE International Conference on
Conference_Location :
Hong Kong
Print_ISBN :
0-7695-2488-5
DOI :
10.1109/ICTAI.2005.129