Title :
Can backpropagation error surface not have local minima
Author_Institution :
Dept. of Radio Eng., Southeast Univ., Nanjing, China
fDate :
11/1/1992 12:00:00 AM
Abstract :
It is shown theoretically that for an arbitrary T-element training set with t(t⩽T) different inputs, the backpropagation error surface does not have suboptimal local minima if the network is capable of exactly implementing an arbitrary training set consisting of t different patterns. As a special case, the error surface of a backpropagation network with one hidden layer and t-1 hidden units has no local minima, if the network is trained by an arbitrary T-element set with t different inputs
Keywords :
backpropagation; neural nets; backpropagation error surface; hidden layer; hidden units; learning; local minima; neural nets; training set; Backpropagation algorithms; Combinatorial mathematics; Convergence; Neural networks; Surface treatment; Vectors;
Journal_Title :
Neural Networks, IEEE Transactions on