Title :
A contribution to convergence theory of fuzzy c-means and derivatives
Author :
Höppner, Frank ; Klawonn, Frank
Author_Institution :
Dept. of Comput. Sci., Univ. of Appl. Sci. BS/WF, Wolfenbuttel, Germany
Abstract :
In this paper, we revisit the convergence and optimization properties of fuzzy clustering algorithms, in general, and the fuzzy c-means (FCM) algorithm, in particular. Our investigation includes probabilistic and (a slightly modified implementation of) possibilistic memberships, which will be discussed under a unified view. We give a convergence proof for the axis-parallel variant of the algorithm by Gustafson and Kessel, that can be generalized to other algorithms more easily than in the usual approach. Using reformulated fuzzy clustering algorithms, we apply Banach´s classical contraction principle and establish a relationship between saddle points and attractive fixed points. For the special case of FCM we derive a sufficient condition for fixed points to be attractive, allowing identification of them as (local) minima of the objective function (excluding the possibility of a saddle point).
Keywords :
convergence of numerical methods; fuzzy set theory; iterative methods; minimisation; pattern clustering; Banach classical contraction principle; Gustafson-Kessel algorithm; attractive fixed points; axis-parallel variant; convergence theory; fixed point iteration; fuzzy c-means; fuzzy clustering algorithms; objective function minima; optimization properties; possibilistic memberships; probabilistic memberships; saddle points; sufficient condition; Clustering algorithms; Computer science; Convergence; Helium; Partitioning algorithms; Phase change materials; Prototypes; Sufficient conditions;
Journal_Title :
Fuzzy Systems, IEEE Transactions on
DOI :
10.1109/TFUZZ.2003.817858