Title :
Fuzzy CMAC With Incremental Bayesian Ying–Yang Learning and Dynamic Rule Construction
Author :
Shi, Daming ; Nguyen, Minh Nhut ; Zhou, Suiping ; Yin, Guisheng
Author_Institution :
Sch. of Electr. Eng. & Comput. Sci., Kyungpook Nat. Univ., Daegu, South Korea
fDate :
4/1/2010 12:00:00 AM
Abstract :
Inspired by the philosophy of ancient Chinese Taoism, Xu´s Bayesian ying-yang (BYY) learning technique performs clustering by harmonizing the training data (yang) with the solution (ying). In our previous work, the BYY learning technique was applied to a fuzzy cerebellar model articulation controller (FCMAC) to find the optimal fuzzy sets; however, this is not suitable for time series data analysis. To address this problem, we propose an incremental BYY learning technique in this paper, with the idea of sliding window and rule structure dynamic algorithms. Three contributions are made as a result of this research. First, an online expectation-maximization algorithm incorporated with the sliding window is proposed for the fuzzification phase. Second, the memory requirement is greatly reduced since the entire data set no longer needs to be obtained during the prediction process. Third, the rule structure dynamic algorithm with dynamically initializing, recruiting, and pruning rules relieves the ??curse of dimensionality?? problem that is inherent in the FCMAC. Because of these features, the experimental results of the benchmark data sets of currency exchange rates and Mackey-Glass show that the proposed model is more suitable for real-time streaming data analysis.
Keywords :
belief networks; expectation-maximisation algorithm; fuzzy set theory; knowledge based systems; learning (artificial intelligence); Bayesian ying-yang learning; cerebellar model articulation controller; curse-of-dimensionality problem; expectation-maximization algorithm; fuzzification phase; fuzzy CMAC; incremental learning; initializing rule; memory requirement; optimal fuzzy sets; prediction process; pruning rule; recruiting rule; rule structure algorithm; rule structure dynamic algorithm; sliding window algorithm; Bayesian ying–yang (BYY) learning; credit assignment; dynamic structure; fuzzy cerebellar model articulation controller (FCMAC); sliding window; Algorithms; Bayes Theorem; Cluster Analysis; Fuzzy Logic; Humans; Models, Genetic; Models, Neurological; Neural Networks (Computer);
Journal_Title :
Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on
DOI :
10.1109/TSMCB.2009.2030333