Title :
Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm
Author :
Yingwei, Lu ; Sundararajan, Narashiman ; Saratchandran, P.
Author_Institution :
Sch. of Electr. & Electron. Eng., Nanyang Technol. Inst., Singapore
fDate :
3/1/1998 12:00:00 AM
Abstract :
Presents a detailed performance analysis of the minimal resource allocation network (M-RAN) learning algorithm, M-RAN is a sequential learning radial basis function neural network which combines the growth criterion of the resource allocating network (RAN) of Platt (1991) with a pruning strategy based on the relative contribution of each hidden unit to the overall network output. The resulting network leads toward a minimal topology for the RAN. The performance of this algorithm is compared with the multilayer feedforward networks (MFNs) trained with 1) a variant of the standard backpropagation algorithm, known as RPROP and 2) the dependence identification (DI) algorithm of Moody and Antsaklis (1996) on several benchmark problems in the function approximation and pattern classification areas. For all these problems, the M-RAN algorithm is shown to realize networks with far fewer hidden neurons with better or same approximation/classification accuracy. Further, the time taken for learning (training) is also considerably shorter as M-RAN does not require repeated presentation of the training data
Keywords :
backpropagation; feedforward neural nets; function approximation; pattern classification; performance evaluation; resource allocation; RPROP; dependence identification; function approximation; growth criterion; minimal resource allocation network; minimal topology; multilayer feedforward networks; pattern classification; performance analysis; performance evaluation; pruning strategy; sequential minimal radial basis function neural network learning algorithm; Approximation algorithms; Backpropagation algorithms; Function approximation; Network topology; Nonhomogeneous media; Pattern classification; Performance analysis; Radial basis function networks; Radio access networks; Resource management;
Journal_Title :
Neural Networks, IEEE Transactions on