Taming the model zoo: a unified view on correlations in recurrent networks
© Grytskyy et al; licensee BioMed Central Ltd. 2012
Published: 16 July 2012
The meaning of correlated neural activity for the processing and representation of information in cortical networks is still not understood, but evidence for a pivotal role of correlations increases . Recent theoretical work has shown [2–4] that balanced recurrent networks of binary model neurons  and spiking integrate-and-fire models [2–4] are able to produce weak correlations despite common input to pairs of cells. For binary model neurons, the theory of correlations in recurrent networks is well established . Investigating learning in recurrent networks with spike-timing dependent plasticity requires spiking neuron models. Theoretical work often employs linear stochastic point process models  for their analytic tractability . The diversity of neuron models used in contemporary theoretical neuroscience brings up the question, which features of correlations are generic properties of recurrent networks and which are peculiarities of the often abstracted neuronal dynamics. Moreover, the variety of different theories employed to describe pairwise correlations in neural networks is confusing at times, even for experts in the field. Currently it is unclear how different neuron models relate to each other and whether and how results obtained with one model carry over to another. In this work we present a unified theoretical view on pairwise correlations in recurrent random networks. We consider binary neuron models, leaky integrate-and-fire models, and linear point process models. For networks in the asynchronous irregular regime, we show that these models can be mapped to either of two definitions of an Ornstein-Uhlenbeck (OU) process . The distinction between both classes is how the effective noise enters the model: Leaky integrate-and-fire models and spiking point process models belong to the class with noise on the output side, the binary neuron model is equivalent to an OU process with noise on the input side. The closed solution for the correlation structure of OU processes  holds for both classes. We extend this solution to the presence of synaptic conduction delays. The presented theory recovers and unifies the theories of correlations for binary neurons  and linear point processes  and generalizes both models to the case of finite conduction delays. Moreover we obtain a good approximation for the temporal structure of correlations for the spiking leaky integrate-and-fire model in the asynchronous regime . Finally we show that the oscillatory instability known for networks of integrate-and-fire models  is a model-invariant feature of any of the studied dynamics and we explain the class dependent differences in the temporal shape of correlation functions.
Partially supported by the Helmholtz Alliance on Systems Biology, the Next-Generation Supercomputer Project of MEXT, and EU Grant 269921 (BrainScaleS). All network simulations were carried out with NEST (http://www.nest-initiative.org).
- Cohen MR, Kohn A: Measuring and interpreting neuronal correlations. Nature Neuro. 2011, 14 (7): 811-819. 10.1038/nn.2842.View ArticleGoogle Scholar
- Hertz J: Cross-Correlations in High-Conductance States of a Model Cortical Network. Neural Computation. 2010, 22 (2): 427-447. 10.1162/neco.2009.06-08-806.View ArticlePubMedGoogle Scholar
- Renart A, De la Rocha J, Bartho P, Hollander L, Parga N, Reyes A, Harris KD: The Asynchronous State in Cortical Circuits. Science. 2010, 327: 587-590. 10.1126/science.1179850.PubMed CentralView ArticlePubMedGoogle Scholar
- Tetzlaff T, Helias M, Einevoll GT, Diesmann M: Decorrelation of neural-network activity by inhibitory feedback. PLoS Comp Biol. 2012, arXiv:1204.4393v1 [q-bio.NC]Google Scholar
- Ginzburg I, Sompolinsky H: Theory of correlations in stochastic neural networks. Phys. Review E. 1994, 50 (4): 3171-3191. 10.1103/PhysRevE.50.3171.View ArticleGoogle Scholar
- Gilson M, Burkitt AN, Grayden DB, Thomas DA, van Hemmen JL: Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks I: Input selectivity - strengthening correlated input pathways. Biol. Cybern. 2009, 101 (2): 81-102. 10.1007/s00422-009-0319-4.View ArticlePubMedGoogle Scholar
- Hawkes A: Point spectra of some mutually exciting point processes. R. Statist. Soc. B. 1971, 33 (3): 438-443.Google Scholar
- Risken H: The Fokker-Planck-Equation. Methods of Solution and Applications. 1989, Berlin: Springer, 2View ArticleGoogle Scholar
- Brunel N: Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons. Journal of Computational Neuroscience. 2000, 8: 183-208. 10.1023/A:1008925309027.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.