Title :
Optimizing the number of hidden nodes of a feedforward artificial neural network
Author :
Fletcher, L. ; Katkovnik, V. ; Steffens, F.E. ; Engelbrecht, A.P.
Author_Institution :
South Africa Univ., Pretoria, South Africa
Abstract :
The number of hidden nodes is a crucial parameter of a feedforward artificial neural network. A neural network with too many nodes may overfit the data, causing poor generalization on data not used for training, while too few hidden units underfit the model, and is not sufficiently accurate. The mean square error between the estimated network and a target function has a minimum with respect to the number of nodes in the hidden layer, and is used to measure the accuracy. In this paper an algorithm is developed which optimizes the number of hidden nodes by minimizing the mean square error over noisy training data. The algorithm combines training sessions with statistical analyses and experimental design to generate new sessions. Simulations show that the developed algorithm requires fewer sessions to establish the optimal number of hidden nodes than using the straightforward way of eliminating nodes successively one by one
Keywords :
design of experiments; feedforward neural nets; generalisation (artificial intelligence); least mean squares methods; noise; optimisation; experimental design; feedforward artificial neural network; hidden nodes; mean square error; minimization; noisy training data; optimization; statistical analyses; target function; Africa; Artificial neural networks; Design for experiments; Input variables; Mean square error methods; Signal to noise ratio; Singular value decomposition; Statistical analysis; Testing; Training data;
Conference_Titel :
Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
Conference_Location :
Anchorage, AK
Print_ISBN :
0-7803-4859-1
DOI :
10.1109/IJCNN.1998.686018
