Efficient simulation of large-scale spiking neural networks using CUDA graphics processors

Authors:
Jayram Moorkanikara Nageswaran;Nikil Dutt;Jeffrey L. Krichmar;Alex Nicolau;Alex Veidenbaum
Affiliations:
Donald Bren School of Information and Computer Science, University of California, Irvine, CA;Donald Bren School of Information and Computer Science, University of California, Irvine, CA;Department of Cognitive Sciences, School of Social Science, University of California, Irvine;Donald Bren School of Information and Computer Science, University of California, Irvine, CA;Donald Bren School of Information and Computer Science, University of California, Irvine, CA
Venue:
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Year:
2009

Citing 10
Cited 7

Pulsed Neural Networks

Pulsed Neural Networks
Simulation of Spiking Neural Networks on Different Hardware Platforms

ICANN '97 Proceedings of the 7th International Conference on Artificial Neural Networks
Polychronization: Computation with Spikes

Neural Computation
Advancing the Boundaries of High-Connectivity Network Simulation with Distributed Computing

Neural Computation
A Multichip Neuromorphic System for Spike-Based Visual Information Processing

Neural Computation
Anatomy of a cortical simulator

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
A closer look at GPUs

Communications of the ACM
Spiking neurons on GPUs

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part IV
Simple model of spiking neurons

IEEE Transactions on Neural Networks
Efficient parallel simulation of large-scale neuronal networks on clusters of multiprocessor computers

Euro-Par'07 Proceedings of the 13th international Euro-Par conference on Parallel Processing

2009 Special Issue: A configurable simulation environment for the efficient simulation of large-scale spiking neural networks on graphics processors

Neural Networks
Acceleration of hierarchical Bayesian network based cortical models on multicore architectures

Parallel Computing
An efficient, high-throughput adaptive NoC router for large scale spiking neural network hardware implementations

ICES'10 Proceedings of the 9th international conference on Evolvable systems: from biology to hardware
Advancing interconnect density for spiking neural network hardware implementations using traffic-aware adaptive network-on-chip routers

Neural Networks
GPGPU implementation of growing neural gas: Application to 3D scene reconstruction

Journal of Parallel and Distributed Computing
Compass: a scalable simulator for an architecture for cognitive computing

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Artificial Neural Network Simulation on CUDA

DS-RT '12 Proceedings of the 2012 IEEE/ACM 16th International Symposium on Distributed Simulation and Real Time Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Neural network simulators that take into account the spiking behavior of neurons are useful for studying brain mechanisms and for engineering applications. Spiking Neural Network (SNN) simulators have been traditionally simulated on large-scale clusters, super-computers, or on dedicated hardware architectures. Alternatively, Graphics Processing Units (GP Us) can provide a low-cost, programmable, and high-performance computing platform for simulation of SNNs. In thi s paper we demonstrate an efficient, Izhikevich neuron based large-scale SNN simulator that runs on a single GPU. The GPU-SNN model (running on an NVIDIA GTX-280 with 1GB of memory), is up to 26 times faster than a CPU version for the simulation of 100K neurons with 50 Million synaptic connections, firing at an average rate of 7Hz. For simulation of 100K neurons with 10 Million synaptic connections, the GPUSNN model is only 1.5 times slower than real-time. Further, we present a collection of new techniques related to parallelism extraction, mapping of irregular communication, and compact network representation for effective simulation of SNNs on GPUs. The fidelity of the simulation results were validated against CPU simulations using firing rate, synaptic weight distribution, and inter-spike interval analysis. We intend to make our simulator available to the modeling community so that researchers will have easy access to large-scale SNN simulations.