• DocumentCode
    928193
  • Title

    Tikhonov training of the CMAC neural network

  • Author

    Weruaga, L. ; Kieslinger, B.

  • Author_Institution
    Comm. for Sci. Visualization, Austrian Acad. of Sci., Vienna
  • Volume
    17
  • Issue
    3
  • fYear
    2006
  • fDate
    5/1/2006 12:00:00 AM
  • Firstpage
    613
  • Lastpage
    622
  • Abstract
    The architecture of the cerebellar model articulation controller (CMAC) presents a rigid compromise between learning and generalization. In the presence of a sparse training dataset, this limitation manifestly causes overfitting, a drawback that is not overcome by current training algorithms. This paper proposes a novel training framework founded on the Tikhonov regularization, which relates to the minimization of the power of the sigma-order derivative. This smoothness criterion yields to an internal cell-interaction mechanism that increases the generalization beyond the degree hardcoded in the CMAC architecture while preserving the potential CMAC learning capabilities. The resulting training mechanism, which proves to be simple and computationally efficient, is deduced from a rigorous theoretical study. The performance of the new training framework is validated against comparative benchmarks from the DELVE environment
  • Keywords
    cerebellar model arithmetic computers; learning (artificial intelligence); CMAC neural network; DELVE environment; Tikhonov regularization training; cerebellar model articulation controller; internal cell-interaction mechanism; sigma-order derivative; sparse training dataset; Adaptive control; Adaptive systems; Associate members; Computer architecture; Feedforward neural networks; Multi-layer neural network; Multidimensional systems; Neural networks; Programmable control; Cerebellar model articulation controller (CMAC); Tikhonov regularization; generalization; overfitting; Algorithms; Artificial Intelligence; Information Storage and Retrieval; Neural Networks (Computer); Pattern Recognition, Automated; Systems Theory;
  • fLanguage
    English
  • Journal_Title
    Neural Networks, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9227
  • Type

    jour

  • DOI
    10.1109/TNN.2006.872348
  • Filename
    1629086