Skip to main content

Advertisement

Scaling, stability and synchronization in mouse-sized (and larger) cortical simulations

Article metrics

  • 782 Accesses

  • 2 Citations

Together, the two hemispheres of the mouse cortex contain, 16 × 106 neurons and 8,000 synapses per neuron. We have recently developed a massively parallel cortical simulator [1] that incorporates relatively simpler single compartment spiking neurons [2], spike-timing dependent plasticity (STDP) [3], and axonal delays.

We created a mouse-scale network by using 32,768 "groups" (80% excitatory) each with 500 neurons such that each group connects to 100 randomly selected groups and each neuron from the projecting group makes a total of c = 80 synapses with the neurons of the receptive group. Excitatory groups had axonal delays uniformly ranging from 1–20 ms, and inhibitory groups had a fixed delay of 1 ms. All simulations used a 1 ms time step. Using a BlueGene/L with 8,192 processors, with 4 TB of memory, using a super-threshold stimulus delivered to every neuron at 4 Hz, we were able to simulate 5 s of model time in 168 s of real-time at a mean firing rate of 4.95 Hz (in stable mode). To further push the boundaries of scaling, by using c = 160 above, we created a network with 16,384,000 neurons and 16,000 synapses per neuron. Using 16,384 processors and 8 TB of memory, using a 5 Hz stimulation, we were able to achieve 5 s of model time in 265 s of real-time at a mean firing rate of 5 Hz (in stable mode).

While it is very easy to drive a network into a damped state or into an avalanche mode, stabilizing cortical simulations is enormously difficult (p. 167, [4]), [5]. We found that the allowed maximum synaptic efficacy (which upper bounds the growth of excitatory synaptic efficacies under STDP) and the probability of the super-threshold stimulus together greatly affected the behavior of networks. We explored several models with varying numbers of synapses from 1 to 16,000 synapses per neuron. We observed that finding a range of maximum synaptic efficacies corresponding to stable models is harder to achieve for higher number of synapses per neuron if the stimulus probability is kept low. Further, there appears to be a threshold stimulus probability below which – when maximum synaptic efficacy is varied – models make a sharp transition from damped to avalanche mode. For both the networks with 16,000 and 8,000 synapses per neuron, we observed three distinct modes, namely, damped, stable, and avalanche (shown in figure 1 for the larger network).

Figure 1
figure1

Damped, stable and avalanche modes in network simulations.

References

  1. 1.

    Frye J, Ananthanarayanan R, Modha DS: Towards real-time, mouse-scale cortical simulations. 2007, CoSyNe: Computational and Systems Neuroscience, Salt Lake City, Utah

  2. 2.

    Izhikevich EM, Gally JA, Edelman GM: Spike-timing dynamics of neuronal groups. Cerebral Cortex. 2004, 14: 933-944. 10.1093/cercor/bhh053.

  3. 3.

    Markram H, Lubke J, Frotscher M, Sakmann B: Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science. 1997, 275: 213-215. 10.1126/science.275.5297.213.

  4. 4.

    Abeles M: Corticonics: Neural Circuits of the Cerebral Cortex. 1991, Cambridge University Press

  5. 5.

    Vogels TP, Rajan K, Abbott LF: Neural network dynamics. Ann Rev Neurosci. 2005, 28: 357-376. 10.1146/annurev.neuro.28.061604.135637.

Download references

Author information

Correspondence to Dharmendra S Modha.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Ananthanarayanan, R., Modha, D.S. Scaling, stability and synchronization in mouse-sized (and larger) cortical simulations. BMC Neurosci 8, P187 (2007) doi:10.1186/1471-2202-8-S2-P187

Download citation

Keywords

  • Firing Rate
  • Model Time
  • Stable Model
  • Sharp Transition
  • Stable Mode