Impact of noise structure and network topology on tracking speed of neural networks

  • Authors:
  • Longwen Huang;Yuwei Cui;Danke Zhang;Si Wu

  • Affiliations:
  • Yuanpei Program and Center for Theoretical Biology, Peking University, Beijing, China;Special Class for the Gifted Young, University of Science and Technology of China, Hefei, China;School of Automation Science and Engineering, South China University of Technology, Guangzhou, China and Lab of Neural Information Processing, Institute of Neuroscience, Chinese Academy of Science ...;Lab of Neural Information Processing, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai 200031, China

  • Venue:
  • Neural Networks
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Understanding why neural systems can process information extremely fast is a fundamental question in theoretical neuroscience. The present study investigates the effect of noise on accelerating neural computation. To evaluate the speed of network response, we consider a computational task in which the network tracks time-varying stimuli. Two noise structures are compared, namely, the stimulus-dependent and stimulus-independent noises. Based on a simple linear integrate-and-fire model, we theoretically analyze the network dynamics, and find that the stimulus-dependent noise, whose variance is proportional to the mean of external inputs, has better effect on speeding up network computation. This is due to two good properties in the transient network dynamics: (1) the instant firing rate of the network is proportional to the mean of external inputs, and (2) the stationary state of the network is robust to stimulus changes. We investigate two network models with varying recurrent interactions, and find that recurrent interactions tend to slow down the tracking speed of the network. When the biologically plausible Hodgkin-Huxley model is considered, we also observe that the stimulus-dependent noise accelerates neural computation, although the improvement is smaller than that in the case of linear integrate-and-fire model.