Title :
A new architecture for digital stochastic pulse-mode neurons based on the voting circuit
Author :
Martincigh, Matteo ; Abramo, Antonio
Author_Institution :
DIEGM. Univ. of Udine, Italy
Abstract :
This paper presents a new kind of architecture for artificial digital neurons based on the voting circuit, which may be considered an improved version of those presented in literature. Stochastic pulse modulation has been used, where the values of the neuron´s inputs are coded in terms of bit probabilities. The resulting activation function closely resembles the logistic sigmoid, with a transition slope that can be selected at the architectural level with no additional hardware requirements. The proposed neuron architecture has been simulated in software. Simulation results confirm that the neuron features a sigmoid transfer characteristic similar to that of conventional voting circuits. The resource occupation of the neuron, as obtained from implementation on reconfigurable platforms, has been estimated to be significantly lower than previous implementations. The theoretical analysis of the neuron´s behavior is also presented.
Keywords :
digital circuits; field programmable gate arrays; neural nets; pulse modulation; stochastic processes; transfer functions; activation function; artificial digital neuron; bit probabilitiy; digital stochastic pulse-mode neuron; logistic sigmoid; neuron digital architecture; sigmoid transfer characteristic; stochastic pulse modulation; transition slope; voting circuit; Artificial neural networks; Field programmable gate arrays; Hardware; Neurons; Pulse circuits; Pulse modulation; Scanning probe microscopy; Stochastic processes; Very large scale integration; Voting; Field-programmable gate array (FPGA) implementation; neuron digital architecture; stochastic pulse modulation; Algorithms; Computer Simulation; Equipment Design; Equipment Failure Analysis; Models, Statistical; Neural Networks (Computer); Signal Processing, Computer-Assisted; Stochastic Processes;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2005.852972