Skip to main content
  • Poster presentation
  • Open access
  • Published:

Taming the model zoo: a unified view on correlations in recurrent networks

The meaning of correlated neural activity for the processing and representation of information in cortical networks is still not understood, but evidence for a pivotal role of correlations increases [1]. Recent theoretical work has shown [24] that balanced recurrent networks of binary model neurons [3] and spiking integrate-and-fire models [24] are able to produce weak correlations despite common input to pairs of cells. For binary model neurons, the theory of correlations in recurrent networks is well established [5]. Investigating learning in recurrent networks with spike-timing dependent plasticity requires spiking neuron models. Theoretical work often employs linear stochastic point process models [6] for their analytic tractability [7]. The diversity of neuron models used in contemporary theoretical neuroscience brings up the question, which features of correlations are generic properties of recurrent networks and which are peculiarities of the often abstracted neuronal dynamics. Moreover, the variety of different theories employed to describe pairwise correlations in neural networks is confusing at times, even for experts in the field. Currently it is unclear how different neuron models relate to each other and whether and how results obtained with one model carry over to another. In this work we present a unified theoretical view on pairwise correlations in recurrent random networks. We consider binary neuron models, leaky integrate-and-fire models, and linear point process models. For networks in the asynchronous irregular regime, we show that these models can be mapped to either of two definitions of an Ornstein-Uhlenbeck (OU) process [8]. The distinction between both classes is how the effective noise enters the model: Leaky integrate-and-fire models and spiking point process models belong to the class with noise on the output side, the binary neuron model is equivalent to an OU process with noise on the input side. The closed solution for the correlation structure of OU processes [8] holds for both classes. We extend this solution to the presence of synaptic conduction delays. The presented theory recovers and unifies the theories of correlations for binary neurons [5] and linear point processes [7] and generalizes both models to the case of finite conduction delays. Moreover we obtain a good approximation for the temporal structure of correlations for the spiking leaky integrate-and-fire model in the asynchronous regime [9]. Finally we show that the oscillatory instability known for networks of integrate-and-fire models [9] is a model-invariant feature of any of the studied dynamics and we explain the class dependent differences in the temporal shape of correlation functions.

References

  1. Cohen MR, Kohn A: Measuring and interpreting neuronal correlations. Nature Neuro. 2011, 14 (7): 811-819. 10.1038/nn.2842.

    Article  CAS  Google Scholar 

  2. Hertz J: Cross-Correlations in High-Conductance States of a Model Cortical Network. Neural Computation. 2010, 22 (2): 427-447. 10.1162/neco.2009.06-08-806.

    Article  PubMed  Google Scholar 

  3. Renart A, De la Rocha J, Bartho P, Hollander L, Parga N, Reyes A, Harris KD: The Asynchronous State in Cortical Circuits. Science. 2010, 327: 587-590. 10.1126/science.1179850.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  4. Tetzlaff T, Helias M, Einevoll GT, Diesmann M: Decorrelation of neural-network activity by inhibitory feedback. PLoS Comp Biol. 2012, arXiv:1204.4393v1 [q-bio.NC]

    Google Scholar 

  5. Ginzburg I, Sompolinsky H: Theory of correlations in stochastic neural networks. Phys. Review E. 1994, 50 (4): 3171-3191. 10.1103/PhysRevE.50.3171.

    Article  CAS  Google Scholar 

  6. Gilson M, Burkitt AN, Grayden DB, Thomas DA, van Hemmen JL: Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks I: Input selectivity - strengthening correlated input pathways. Biol. Cybern. 2009, 101 (2): 81-102. 10.1007/s00422-009-0319-4.

    Article  PubMed  Google Scholar 

  7. Hawkes A: Point spectra of some mutually exciting point processes. R. Statist. Soc. B. 1971, 33 (3): 438-443.

    Google Scholar 

  8. Risken H: The Fokker-Planck-Equation. Methods of Solution and Applications. 1989, Berlin: Springer, 2

    Chapter  Google Scholar 

  9. Brunel N: Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons. Journal of Computational Neuroscience. 2000, 8: 183-208. 10.1023/A:1008925309027.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Partially supported by the Helmholtz Alliance on Systems Biology, the Next-Generation Supercomputer Project of MEXT, and EU Grant 269921 (BrainScaleS). All network simulations were carried out with NEST (http://www.nest-initiative.org).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dmytro Grytskyy.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Grytskyy, D., Helias, M., Tetzlaff, T. et al. Taming the model zoo: a unified view on correlations in recurrent networks. BMC Neurosci 13 (Suppl 1), P147 (2012). https://doi.org/10.1186/1471-2202-13-S1-P147

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-13-S1-P147

Keywords