DocumentCode :
928193
Title :
Tikhonov training of the CMAC neural network
Author :
Weruaga, L. ; Kieslinger, B.
Author_Institution :
Comm. for Sci. Visualization, Austrian Acad. of Sci., Vienna
Volume :
17
Issue :
3
fYear :
2006
fDate :
5/1/2006 12:00:00 AM
Firstpage :
613
Lastpage :
622
Abstract :
The architecture of the cerebellar model articulation controller (CMAC) presents a rigid compromise between learning and generalization. In the presence of a sparse training dataset, this limitation manifestly causes overfitting, a drawback that is not overcome by current training algorithms. This paper proposes a novel training framework founded on the Tikhonov regularization, which relates to the minimization of the power of the sigma-order derivative. This smoothness criterion yields to an internal cell-interaction mechanism that increases the generalization beyond the degree hardcoded in the CMAC architecture while preserving the potential CMAC learning capabilities. The resulting training mechanism, which proves to be simple and computationally efficient, is deduced from a rigorous theoretical study. The performance of the new training framework is validated against comparative benchmarks from the DELVE environment
Keywords :
cerebellar model arithmetic computers; learning (artificial intelligence); CMAC neural network; DELVE environment; Tikhonov regularization training; cerebellar model articulation controller; internal cell-interaction mechanism; sigma-order derivative; sparse training dataset; Adaptive control; Adaptive systems; Associate members; Computer architecture; Feedforward neural networks; Multi-layer neural network; Multidimensional systems; Neural networks; Programmable control; Cerebellar model articulation controller (CMAC); Tikhonov regularization; generalization; overfitting; Algorithms; Artificial Intelligence; Information Storage and Retrieval; Neural Networks (Computer); Pattern Recognition, Automated; Systems Theory;
fLanguage :
English
Journal_Title :
Neural Networks, IEEE Transactions on
Publisher :
ieee
ISSN :
1045-9227
Type :
jour
DOI :
10.1109/TNN.2006.872348
Filename :
1629086
Link To Document :
بازگشت