Title :
Approximate representation of a continuous function by a neural network with scaled or unscaled sigmoid units
Author_Institution :
Nagoya Univ. Coll. of Med. Technol., Japan
Abstract :
Summary form only given. The author investigates the capability of three-layered neural networks with a scaled or unscaled sigmoid activation function of the hidden layer units in uniformly approximate representation of continuous functions. For the approximation on a compact set, any sigmoid function can be the activation function without scaling. Even for the approximation of continuous functions on Rd , any sigmoid function if scalable can be the activation function, but only a certain class of sigmoid functions can be without scaling. A necessary and sufficient condition ensuring that a sigmoid function belongs to this class has been obtained. Sketches of constructive proofs of some results, which can be regarded as algorithms for implementing the uniform approximations, were given
Keywords :
function approximation; neural nets; activation function; continuous function; hidden layer units; necessary and sufficient condition; neural network; sigmoid units; Design optimization; Educational institutions; Feature extraction; Health and safety; Indium tin oxide; Laboratories; Neural networks; Pattern recognition; Risk analysis; Sufficient conditions;
Conference_Titel :
Neural Networks, 1991., IJCNN-91-Seattle International Joint Conference on
Conference_Location :
Seattle, WA
Print_ISBN :
0-7803-0164-1
DOI :
10.1109/IJCNN.1991.155459