Title :
Power series analyses of back-propagation neural networks
Author :
Chen, Mu-Song ; Manry, Michael T.
Author_Institution :
Dept. of Electr. Eng., Texas Univ., Arlington, TX, USA
Abstract :
Presents a technique for analyzing backpropagation neural networks. Each hidden unit in the network is modeled as a power series of the net function. This approach allows determination of the degree of the overall polynomial discriminant, which approximates the network, potentially revealing the complexity of the decision boundary for the training data. Hidden units whose models are constant or have degree 1 can be pruned, thereby simplifying the network. The modeling technique can be used as a probe to investigate the success or failure of training. The approximation was applied to two example neural nets designed to perform nonlinear filtering tasks
Keywords :
filtering and prediction theory; neural nets; polynomials; series (mathematics); backpropagation neural networks; complexity; decision boundary; hidden unit; nonlinear filtering; polynomial discriminant; power series; training data; Data analysis; Feeds; Filtering; Matrix decomposition; Mean square error methods; Multilayer perceptrons; Neural networks; Polynomials; Probes; Training data;
Conference_Titel :
Neural Networks, 1991., IJCNN-91-Seattle International Joint Conference on
Conference_Location :
Seattle, WA
Print_ISBN :
0-7803-0164-1
DOI :
10.1109/IJCNN.1991.155193