Title :
Multilayer feedforward networks with adaptive spline activation function
Author :
Guarnieri, Stefano ; Piazza, Francesco ; Uncini, Aurelio
Author_Institution :
Dipt. di Elettronica e Autom., Ancona Univ., Italy
fDate :
5/1/1999 12:00:00 AM
Abstract :
In this paper, a new adaptive spline activation function neural network (ASNN) is presented. Due to the ASNN´s high representation capabilities, networks with a small number of interconnections can be trained to solve both pattern recognition and data processing real-time problems. The main idea is to use a Catmull-Rom cubic spline as the neuron´s activation function, which ensures a simple structure suitable for both software and hardware implementation. Experimental results demonstrate improvements in terms of generalization capability and of learning speed in both pattern recognition and data processing tasks
Keywords :
backpropagation; feedforward neural nets; generalisation (artificial intelligence); multilayer perceptrons; pattern recognition; splines (mathematics); transfer functions; Catmull-Rom cubic spline; adaptive spline activation function; backpropagation; data processing; feedforward neural networks; generalised sigmoidal function; generalization; multilayer neural networks; multilayer perceptron; pattern recognition; real-time system; Adaptive systems; Data processing; Multi-layer neural network; Neural networks; Nonhomogeneous media; Pattern recognition; Polynomials; Shape; Spline; Table lookup;
Journal_Title :
Neural Networks, IEEE Transactions on