DocumentCode
2327408
Title
Digital pulse mode neuron with robust nonlinear activation function
Author
Hikawa, Hiroomi
Author_Institution
Dept. of Comput. Sci. & Intelligent Syst., Oita Univ., Japan
Volume
4
fYear
2004
fDate
25-29 July 2004
Firstpage
2665
Abstract
This paper proposes a new type of digital synchronous pulse mode neuron with robust nonlinear activation function. Proposed neuron employs additive Gaussian random noise and exponential averaging for input signals to have stable internal potential. Theoretical analysis and simulations are carried out to verify the feasibility of the neuron. The results show that the activation function is invariable against the change of the number of inputs to the neuron. Experimental multilayer neural network is fabricated with the proposed neurons to perform binary classification problems. Experimental results show that the proposed neuron has comparable performance to other neurons while requiring less hardware and providing faster operation.
Keywords
Gaussian noise; multilayer perceptrons; neural chips; nonlinear functions; additive Gaussian random noise; binary classification problems; digital synchronous pulse mode neuron; exponential averaging; multilayer neural network; robust nonlinear activation function; stable internal potential; Analytical models; Artificial neural networks; Circuits; Computer science; Multi-layer neural network; Neural networks; Neurons; Random number generation; Robustness; Signal generators;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on
ISSN
1098-7576
Print_ISBN
0-7803-8359-1
Type
conf
DOI
10.1109/IJCNN.2004.1381069
Filename
1381069
Link To Document