Skip to main content
  • Poster presentation
  • Open access
  • Published:

Functional consequences of non-equilibrium dynamics caused by antisymmetric and symmetric learning rules

Connectivity in the brain is asymmetric, which is evident by Dale's principle of excitatory and inhibitory neurons. As a consequence, biologically realistic neuronal networks cannot be in thermodynamic equilibrium [1]. Even in a stationary state, probability fluxes perpetuate, leading to non-equilibrium steady states [2, 3]. We here investigate the computational consequences of non-equilibrium dynamics for synaptic plasticity and learning. Formulating the stochastic dynamics in sparsely connected networks of non-linear Langevin equations in terms of path integrals [4], we show that biologically plausible correlation-sensitive plasticity rules follow from first principles. We investigate two different rules: 1.) Maximizing a measure of irreversibility [2] by gradient descent with respect to the weights, we obtain a local learning rule sensitive to the derivative of the covariance between the pre- and postsynaptic neuron. The obtained rule can be interpreted as spike-timing dependent plasticity (STDP) [5, 6] with a narrow antisymmetric learning window. We show that the learning rule increases synaptic weights in the direction of the (direct or indirect) causal influence between a pair of neurons. In this way indirect causal relationships are transformed into strengthened direct connections. An instability of the state with vanishing weights manifests itself as spontaneous symmetry breaking and the divergence of connection weights. 2.) We investigate a rule that is sensitive to the zero-time-lag covariance. It can be considered as a complement to the first rule approximating STDP with a symmetric narrow learning window. This rule results in the strengthening of loops, of mutual connections between neurons getting common input, and of indirect (also backward) connections between neurons a and b if a influences b. We derive analytical expressions that describe these effects quantitatively. We show how nonlinearities in the neuronal transmission naturally stabilize synaptic weights and how the limited dynamic range of neuronal activity mediates competition between synapses. The work elucidates the tight connection between measures of reversible and irreversible dynamics and the structures resulting from learning rules that optimize either of the two.

References

  1. Sompolinsky H: Statistical mechanics of neuronal networks. Physics Today. 1988, 70-80.

    Google Scholar 

  2. Seifert U: Stochastic thermodynamics, fluctuation theorems, and molecular machines. Rep Prog Phys. 2012, 75: 126001-doi:10.1088/0034-4885/75/12/126001

    Article  PubMed  Google Scholar 

  3. Evans DJ, Morriss GP: Statistical Mechanics of Non Equilibrium Liquids. 1990, London: Academic Press

    Google Scholar 

  4. Wio HS, Colet P, San Miguel M: Path-integral formulation for stochastic processes driven by colored noise. Phys Rev A. 1989, 40: 7312-7324.

    Article  PubMed  Google Scholar 

  5. Bi GQ, Poo MM: Synaptic modifications in cultured Hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci. 1998, 18: 10464-72.

    PubMed  CAS  Google Scholar 

  6. Morrison A, Diesmann M, Gerstner W: Phenomenological models of synaptic plasticity based on spike timing. Biol Cybern. 2008, 98: 459-478.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Partially supported by the Helmholtz portfolio theme SMHB, the Jülich Aachen Research Alliance (JARA), HGF Young Investigator's Group VH-NG-1028, EU Grants 269921 (BrainScaleS) and 604102 (HBP).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dmytro Grytskyy.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grytskyy, D., Diesmann, M. & Helias, M. Functional consequences of non-equilibrium dynamics caused by antisymmetric and symmetric learning rules. BMC Neurosci 16 (Suppl 1), P96 (2015). https://doi.org/10.1186/1471-2202-16-S1-P96

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-16-S1-P96

Keywords