Skip to main content

Advertisement

Learning spike-timings based representations of sensory stimuli with leaky integrate-and-fire neurons

Article metrics

  • 1035 Accesses

Introduction

Stimuli from the environment are sensed by a population of receptor neurons and then carried by spike trains to further processing stages in the brain. Our work deals with the question how, in the early sensory system, rich stimuli from the natural environment can be represented by spike trains. In theoretical approaches to this questions, neural representation is often modeled as an encoder-decoder system: a sensory stimulus is encoded into neural activity and a hypothetical decoder indicated how the neural activity must be read to construct the internal representation of the stimulus.

Previous work

Assuming models for the encoder-decoder pair, in previous work, the free parameters in the models have been learned from natural stimuli, and successfully related to properties of the early sensory system [1]. Much emphasis in previous work has been on the principle that guide the learning process, for example information theoretical [2, 3] or energetic principles [4]. Less attention was given to the role of the underlying neuron model. Recently, we have proposed in [5, 6] data representation where the encoding happens with a simple spiking neuron model (the Spike Response Model SRM_0 [7]) and the spike timings serve to continuously update the ongoing internal representation.

Results

Here, we first formulate the theory of an encoder-decoder system for leaky integrate-and-fire neurons and then extend the previous models of learning spike timings-based representations. As time is explicitly present in our framework, the internal representation that is constructed from the spike timings can be about the stimulus prior to the spike or an internal prediction of the future stimulus. We present the learning of an encoder-decoder pair where each spike is used both to update the prediction of the future stimulus and to correct the representation of the stimulus before the spike. We present thus the learning of a prediction-and-correction based internal representation of the sensory stimulus.

References

  1. 1.

    Simoncelli E, Olshausen B: Natural image statistics and neural representation. Annual Review of Neuroscience. 2001, 24: 1193-1216. 10.1146/annurev.neuro.24.1.1193.

  2. 2.

    Olshausen B, Field D: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996, 381: 607-609. 10.1038/381607a0.

  3. 3.

    Smith E, Lewicki M: Efficient auditory coding. Nature. 2006, 439: 978-982. 10.1038/nature04485.

  4. 4.

    Vincent BT, Baddeley RJ, Troscianko T, Gilchrist ID: Is the early visual system optimised to be energy efficient?. Network: Computation in Neural Systems. 2006, 16: 175-190. 10.1080/09548980500290047.

  5. 5.

    Gutmann M, Hyvärinen A, Aihara K: Learning encoding and decoding filters for data representation with a spiking neuron. International Joint Conference on Neural Networks (IJCNN2008). 2008

  6. 6.

    Gutmann M, Hyvärinen A: Learning reconstruction and prediction of natural stimuli by a population of spiking neurons. European Symposium on Artificial Neural Networks (ESANN2009). 2009-05-12

  7. 7.

    Gerstner W, Kistler WK: Spiking Neuron Models. 2002, Cambridge University Press

Download references

Acknowledgements

This work was funder by the Academy of Finland (NEURO program and the Algodam Centre of Excellence).

Author information

Correspondence to Michael Gutmann.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Keywords

  • Neural Activity
  • Internal Representation
  • Spike Train
  • Neuron Model
  • Sensory Stimulus