Title :
Functional abilities of a stochastic logic neural network
Author :
Kondo, Yoshikazu ; Sawada, Yasuji
Author_Institution :
Res. Inst. of Electr. Commun., Tohoku Univ., Sendai, Japan
fDate :
5/1/1992 12:00:00 AM
Abstract :
The authors have studied the information processing ability of stochastic logic neural networks, which constitute one of the pulse-coded artificial neural network families. These networks realize pseudoanalog performance with local learning rules using digital circuits, and therefore suit silicon technology. The synaptic weights and the outputs of neurons in stochastic logic are represented by stochastic pulse sequences. The limited range of the synaptic weights reduces the coding noise and suppresses the degradation of memory storage capacity. To study the effect of the coding noise on an optimization problem, the authors simulate a probabilistic Hopfield model (Gaussian machine) which has a continuous neuron output function and probabilistic behavior. A proper choice of the coding noise amplitude and scheduling improves the network´s solutions of the traveling salesman problem (TSP). These results suggest that stochastic logic may be useful for implementing probabilistic dynamics as well as deterministic dynamics
Keywords :
learning systems; neural nets; probability; stochastic processes; coding noise; coding noise amplitude; continuous neuron output function; deterministic dynamics; digital circuits; information processing ability; local learning rules; memory storage capacity; optimization problem; probabilistic Hopfield model; probabilistic dynamics; pseudoanalog performance; scheduling; stochastic logic neural network; stochastic pulse sequences; synaptic weights; traveling salesman problem; Artificial neural networks; Circuit noise; Digital circuits; Information processing; Logic; Neural networks; Neurons; Silicon; Stochastic processes; Stochastic resonance;
Journal_Title :
Neural Networks, IEEE Transactions on