Title :
Combination of online Clustering and Q-value based genetic reinforcement learning for fuzzy network design
Author :
Juang, Chia-Feng ; Lu, Chun-Feng
Author_Institution :
Dept. of Electr. Eng., Nat. Chung-Hsing Univ., Taichung, Taiwan
Abstract :
This paper proposes a combination of on-line Clustering and Q-value based Genetic Algorithm learning scheme for Fuzzy network design (CQGAF) with reinforcements. The CQGAF fulfills GA based fuzzy network design under reinforcement learning environment where only weak reinforcement signals such as "success" and "failure" are available. In CQGAF, there are no fuzzy rules initially. They are generated automatically. The precondition part of a fuzzy network is online constructed by an aligned clustering-based approach. Simultaneously, the consequent part is designed by Q-value based genetic reinforcement learning. In CQGAF, evolution is performed immediately after the end of one trial in contrast to general GA where many trials are performed before evolution. The feasibility of CQGAF is demonstrated through simulations in cart-pole balancing problems with only binary reinforcement signals.
Keywords :
fuzzy neural nets; fuzzy set theory; genetic algorithms; learning (artificial intelligence); pattern clustering; Q-value based genetic reinforcement learning; binary reinforcement signals; cart-pole balancing problems; fuzzy network design; fuzzy rules; fuzzy systems; online clustering; Algorithm design and analysis; Clustering algorithms; Fuzzy sets; Fuzzy systems; Genetic algorithms; Inference algorithms; Learning; Signal design; State estimation; Stochastic processes;
Conference_Titel :
Neural Networks, 2003. Proceedings of the International Joint Conference on
Print_ISBN :
0-7803-7898-9
DOI :
10.1109/IJCNN.2003.1223695