- Oral presentation
- Open Access
The high-conductance state enables neural sampling in networks of LIF neurons
© Petrovici et al. 2015
- Published: 18 December 2015
- Burst Spike
- Correct Dynamic
- Membrane Time Constant
- Binary Random Variable
- Machine Learning Problem
The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain [1–3]. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons [4, 5]. One particular requirement of this approach is that the membrane potential of these neurons satisfies the so-called neural computability condition (NCC), which in turn leads to a logistic neural response function.
Analytical approaches to calculating this function have been the subject of many theoretical studies. In order to make the problem tractable, particular assumptions regarding the neural or synaptic parameters are usually made [6, 7]. However, biologically significant activity regimes exist which are not covered by these approaches: Under strong synaptic bombardment, as is often the case in cortex, the neuron is shifted into a high-conductance state (HCS), which is characterized by a small membrane time constant. In this regime, synaptic time constants and refractory periods dominate membrane dynamics.
The HCS is also particularly interesting from a functional point of view. In , we have shown that LIF neurons that are shifted into a HCS by background synaptic bombardment can attain the correct firing statistics to sample from well-defined probability distributions (i.e., satisfy the NCC). In order to calculate the response function of neurons in this regime, we are required to consider a new approach.
The core idea of this approach is to separately consider two different "modes" of spiking dynamics: burst spiking and transient quiescence, in which the neuron does not spike for longer periods. For the bursting mode, we explicitly take into consideration the autocorrelation of the membrane potential before and after refractoriness by propagating the PDF of the effective membrane potential from spike to spike within a burst. For the membrane potential evolution between bursts, we consider an Ornstein-Uhlenbeck approximation. We find that our theoretical prediction of the neural response function closely matches simulation data. Moreover, in the HCS scenario, we show that the neural response function becomes symmetric and can be well approximated by a logistic function, thereby providing the correct dynamics in order to perform neural sampling. Such stochastic firing units can then be used to sample from arbitrary probability distributions over binary random variables [4, 5, 8, 9]. We hereby provide not only a normative framework for Bayesian inference in cortex, but also powerful applications of low-power, accelerated neuromorphic systems to highly relevant machine learning problems.
This research was supported by EU grants #269921 (BrainScaleS), #237955 (FACETS-ITN), #604102 (Human Brain Project), the Austrian Science Fund FWF #I753-N23 (PNEUMA) and the Manfred Stärk Foundation.
- Körding K, Wolpert D: Bayesian integration in sensorimotor learning. Nature. 2004, 427: 244-247.PubMedView ArticleGoogle Scholar
- Fizser J, Berkes P, Orbán G, Lengyel M: Statistically optimal perception and learning: from behavior to neural representations. Trends in Cognitive Sciences. 2010, 14 (3): 119-130.View ArticleGoogle Scholar
- Friston K, Mattout J, Kilner J: Action understanding and active inference. Biological Cybernetics. 2011, 104 (1-2): 137-160.PubMedPubMed CentralView ArticleGoogle Scholar
- Büsing Lars, Bill Johannes, Nessler Bernhard, Maass Wolfgang: Neural dynamics as sampling: A model for stochastic computation in recurrent networks of spiking neurons. PLoS Computational Biology. 2011, 7 (11): e1002211-View ArticleGoogle Scholar
- Petrovici MA, Bill J, Bytschok I, Schemmel J, Karlheinz Meier: Stochastic inference with deterministic spiking neurons. arXiv preprint. 2013, 1311.3211Google Scholar
- Brunel N, Sergi S: Firing Frequency of leaky integrate-and-fire neurons with synaptic current dynamics. Journal of Theoretical Biology. 1998, 195 (1): 87-95.PubMedView ArticleGoogle Scholar
- Moreno-Bote R, Parga N: Role of synaptic filtering on the firing response of simple model neurons. Physical Review Letters. 2004, 92: 028102-PubMedView ArticleGoogle Scholar
- Pecevski D, Büsing L, Maass W: Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons. PLoS Computational Biology. 2011, 7 (12): e1002294-PubMedPubMed CentralView ArticleGoogle Scholar
- Probst D, Petrovici MA, Bytschok I, Bill J, Peceyski D, Schemmel J, Meier K: Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons. Frontiers in Neuroscience. 2015, 9: 13-Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.