- Poster presentation
- Open Access
Functional consequences of non-equilibrium dynamics caused by antisymmetric and symmetric learning rules
© Grytskyy et al. 2015
- Published: 18 December 2015
- Learning Rule
- Synaptic Weight
- Spontaneous Symmetry Breaking
- Local Learning
- Dependent Plasticity
Connectivity in the brain is asymmetric, which is evident by Dale's principle of excitatory and inhibitory neurons. As a consequence, biologically realistic neuronal networks cannot be in thermodynamic equilibrium . Even in a stationary state, probability fluxes perpetuate, leading to non-equilibrium steady states [2, 3]. We here investigate the computational consequences of non-equilibrium dynamics for synaptic plasticity and learning. Formulating the stochastic dynamics in sparsely connected networks of non-linear Langevin equations in terms of path integrals , we show that biologically plausible correlation-sensitive plasticity rules follow from first principles. We investigate two different rules: 1.) Maximizing a measure of irreversibility  by gradient descent with respect to the weights, we obtain a local learning rule sensitive to the derivative of the covariance between the pre- and postsynaptic neuron. The obtained rule can be interpreted as spike-timing dependent plasticity (STDP) [5, 6] with a narrow antisymmetric learning window. We show that the learning rule increases synaptic weights in the direction of the (direct or indirect) causal influence between a pair of neurons. In this way indirect causal relationships are transformed into strengthened direct connections. An instability of the state with vanishing weights manifests itself as spontaneous symmetry breaking and the divergence of connection weights. 2.) We investigate a rule that is sensitive to the zero-time-lag covariance. It can be considered as a complement to the first rule approximating STDP with a symmetric narrow learning window. This rule results in the strengthening of loops, of mutual connections between neurons getting common input, and of indirect (also backward) connections between neurons a and b if a influences b. We derive analytical expressions that describe these effects quantitatively. We show how nonlinearities in the neuronal transmission naturally stabilize synaptic weights and how the limited dynamic range of neuronal activity mediates competition between synapses. The work elucidates the tight connection between measures of reversible and irreversible dynamics and the structures resulting from learning rules that optimize either of the two.
Partially supported by the Helmholtz portfolio theme SMHB, the Jülich Aachen Research Alliance (JARA), HGF Young Investigator's Group VH-NG-1028, EU Grants 269921 (BrainScaleS) and 604102 (HBP).
- Sompolinsky H: Statistical mechanics of neuronal networks. Physics Today. 1988, 70-80.Google Scholar
- Seifert U: Stochastic thermodynamics, fluctuation theorems, and molecular machines. Rep Prog Phys. 2012, 75: 126001-doi:10.1088/0034-4885/75/12/126001PubMedView ArticleGoogle Scholar
- Evans DJ, Morriss GP: Statistical Mechanics of Non Equilibrium Liquids. 1990, London: Academic PressGoogle Scholar
- Wio HS, Colet P, San Miguel M: Path-integral formulation for stochastic processes driven by colored noise. Phys Rev A. 1989, 40: 7312-7324.PubMedView ArticleGoogle Scholar
- Bi GQ, Poo MM: Synaptic modifications in cultured Hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci. 1998, 18: 10464-72.PubMedGoogle Scholar
- Morrison A, Diesmann M, Gerstner W: Phenomenological models of synaptic plasticity based on spike timing. Biol Cybern. 2008, 98: 459-478.PubMedPubMed CentralView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.