DocumentCode
928193
Title
Tikhonov training of the CMAC neural network
Author
Weruaga, L. ; Kieslinger, B.
Author_Institution
Comm. for Sci. Visualization, Austrian Acad. of Sci., Vienna
Volume
17
Issue
3
fYear
2006
fDate
5/1/2006 12:00:00 AM
Firstpage
613
Lastpage
622
Abstract
The architecture of the cerebellar model articulation controller (CMAC) presents a rigid compromise between learning and generalization. In the presence of a sparse training dataset, this limitation manifestly causes overfitting, a drawback that is not overcome by current training algorithms. This paper proposes a novel training framework founded on the Tikhonov regularization, which relates to the minimization of the power of the sigma-order derivative. This smoothness criterion yields to an internal cell-interaction mechanism that increases the generalization beyond the degree hardcoded in the CMAC architecture while preserving the potential CMAC learning capabilities. The resulting training mechanism, which proves to be simple and computationally efficient, is deduced from a rigorous theoretical study. The performance of the new training framework is validated against comparative benchmarks from the DELVE environment
Keywords
cerebellar model arithmetic computers; learning (artificial intelligence); CMAC neural network; DELVE environment; Tikhonov regularization training; cerebellar model articulation controller; internal cell-interaction mechanism; sigma-order derivative; sparse training dataset; Adaptive control; Adaptive systems; Associate members; Computer architecture; Feedforward neural networks; Multi-layer neural network; Multidimensional systems; Neural networks; Programmable control; Cerebellar model articulation controller (CMAC); Tikhonov regularization; generalization; overfitting; Algorithms; Artificial Intelligence; Information Storage and Retrieval; Neural Networks (Computer); Pattern Recognition, Automated; Systems Theory;
fLanguage
English
Journal_Title
Neural Networks, IEEE Transactions on
Publisher
ieee
ISSN
1045-9227
Type
jour
DOI
10.1109/TNN.2006.872348
Filename
1629086
Link To Document