Title :
Classification ability of single hidden layer feedforward neural networks
Author :
Huang, Guang-Bin ; Chen, Yan-Qiu ; Babri, Haroon A.
Author_Institution :
Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore
fDate :
5/1/2000 12:00:00 AM
Abstract :
Multilayer perceptrons with hard-limiting (signum) activation functions can form complex decision regions. It is well known that a three-layer perceptron (two hidden layers) can form arbitrary disjoint decision regions and a two-layer perceptron (one hidden layer) can form single convex decision regions. This paper further proves that single hidden layer feedforward neural networks (SLFN) with any continuous bounded nonconstant activation function or any arbitrary bounded (continuous or not continuous) activation function which has unequal limits at infinities (not just perceptrons) can form disjoint decision regions with arbitrary shapes in multidimensional cases, SLFN with some unbounded activation function can also form disjoint decision regions with arbitrary shapes
Keywords :
feedforward neural nets; multilayer perceptrons; pattern classification; transfer functions; SLFN; classification ability; complex decision regions; continuous bounded nonconstant activation function; convex decision regions; disjoint decision regions; hard-limiting activation functions; multilayer perceptron; multilayer perceptrons; signum activation functions; single hidden layer feedforward neural networks; three-layer perceptron; two-layer perceptron; Feedforward neural networks; H infinity control; Indium tin oxide; Manufacturing; Multi-layer neural network; Multidimensional systems; Multilayer perceptrons; Neural networks; Pattern classification; Shape;
Journal_Title :
Neural Networks, IEEE Transactions on