Title :
A Spiking Neural Simulator Integrating Event-Driven and Time-Driven Computation Schemes Using Parallel CPU-GPU Co-Processing: A Case Study
Author :
Naveros, Francisco ; Luque, Niceto R. ; Garrido, Jesus A. ; Carrillo, Richard R. ; Anguita, Mancia ; Ros, Eduardo
Author_Institution :
Univ. of Granada, Granada, Spain
fDate :
7/1/2015 12:00:00 AM
Abstract :
Time-driven simulation methods in traditional CPU architectures perform well and precisely when simulating small-scale spiking neural networks. Nevertheless, they still have drawbacks when simulating large-scale systems. Conversely, event-driven simulation methods in CPUs and time-driven simulation methods in graphic processing units (GPUs) can outperform CPU time-driven methods under certain conditions. With this performance improvement in mind, we have developed an event-and-time-driven spiking neural network simulator suitable for a hybrid CPU-GPU platform. Our neural simulator is able to efficiently simulate bio-inspired spiking neural networks consisting of different neural models, which can be distributed heterogeneously in both small layers and large layers or subsystems. For the sake of efficiency, the low-activity parts of the neural network can be simulated in CPU using event-driven methods while the high-activity subsystems can be simulated in either CPU (a few neurons) or GPU (thousands or millions of neurons) using time-driven methods. In this brief, we have undertaken a comparative study of these different simulation methods. For benchmarking the different simulation methods and platforms, we have used a cerebellar-inspired neural-network model consisting of a very dense granular layer and a Purkinje layer with a smaller number of cells (according to biological ratios). Thus, this cerebellar-like network includes a dense diverging neural layer (increasing the dimensionality of its internal representation and sparse coding) and a converging neural layer (integration) similar to many other biologically inspired and also artificial neural networks.
Keywords :
graphics processing units; neural nets; parallel processing; Purkinje layer; central processing unit; cerebellar-like network; converging neural layer; dense diverging neural layer; event-driven computation scheme; graphics processing unit; neural models; parallel CPU-GPU coprocessing; small-scale spiking neural networks; spiking neural simulator; time-driven computation scheme; time-driven simulation methods; very dense granular layer; Accuracy; Biological neural networks; Central Processing Unit; Computational modeling; Graphics processing units; Neurons; Vectors; Co-processing CPU–graphic processor units (GPUs); Co-processing CPU???graphic processor units (GPUs); event-driven execution; event-driven neural simulator based on lookup table (EDLUT); real time; simulation; spiking neural network; time-driven execution;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2345844