Title :
A TSK-type neurofuzzy network approach to system modeling problems
Author :
Ouyang, Chen-Sen ; Lee, Wan-Jui ; Lee, Shie-Jue
Author_Institution :
Dept. of Inf. Eng., I-Shou Univ., Taiwan
Abstract :
We develop a neurofuzzy network technique to extract TSK-type fuzzy rules from a given set of input-output data for system modeling problems. Fuzzy clusters are generated incrementally from the training dataset, and similar clusters are merged dynamically together through input-similarity, output-similarity, and output-variance tests. The associated membership functions are defined with statistical means and deviations. Each cluster corresponds to a fuzzy IF-THEN rule, and the obtained rules can be further refined by a fuzzy neural network with a hybrid learning algorithm which combines a recursive singular value decomposition-based least squares estimator and the gradient descent method. The proposed technique has several advantages. The information about input and output data subspaces is considered simultaneously for cluster generation and merging. Membership functions match closely with and describe properly the real distribution of the training data points. Redundant clusters are combined, and the sensitivity to the input order of training data is reduced. Besides, generation of the whole set of clusters from the scratch can be avoided when new training data are considered.
Keywords :
fuzzy neural nets; knowledge acquisition; learning (artificial intelligence); singular value decomposition; statistical testing; TSK-type fuzzy rules; fuzzy neural network; gradient descent method; hybrid learning algorithm; least squares estimation; neurofuzzy network approach; recursive singular value decomposition; system modeling problem; training dataset; Clustering algorithms; Data mining; Fuzzy neural networks; Fuzzy sets; Fuzzy systems; Least squares approximation; Modeling; Recursive estimation; Testing; Training data; Fuzzy neural network; TSK model; fuzzy rule; gradient descent; neurofuzzy; similarity measure; singular value decomposition (SVD); Algorithms; Cluster Analysis; Computer Simulation; Fuzzy Logic; Information Storage and Retrieval; Models, Biological; Models, Statistical; Neural Networks (Computer); Pattern Recognition, Automated;
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/TSMCB.2005.846000