Learning spike-timings based representations of sensory stimuli with leaky integrate-and-fire neurons
© Gutmann and Hyvärinen; licensee BioMed Central Ltd. 2009
Published: 13 July 2009
Stimuli from the environment are sensed by a population of receptor neurons and then carried by spike trains to further processing stages in the brain. Our work deals with the question how, in the early sensory system, rich stimuli from the natural environment can be represented by spike trains. In theoretical approaches to this questions, neural representation is often modeled as an encoder-decoder system: a sensory stimulus is encoded into neural activity and a hypothetical decoder indicated how the neural activity must be read to construct the internal representation of the stimulus.
Assuming models for the encoder-decoder pair, in previous work, the free parameters in the models have been learned from natural stimuli, and successfully related to properties of the early sensory system . Much emphasis in previous work has been on the principle that guide the learning process, for example information theoretical [2, 3] or energetic principles . Less attention was given to the role of the underlying neuron model. Recently, we have proposed in [5, 6] data representation where the encoding happens with a simple spiking neuron model (the Spike Response Model SRM_0 ) and the spike timings serve to continuously update the ongoing internal representation.
Here, we first formulate the theory of an encoder-decoder system for leaky integrate-and-fire neurons and then extend the previous models of learning spike timings-based representations. As time is explicitly present in our framework, the internal representation that is constructed from the spike timings can be about the stimulus prior to the spike or an internal prediction of the future stimulus. We present the learning of an encoder-decoder pair where each spike is used both to update the prediction of the future stimulus and to correct the representation of the stimulus before the spike. We present thus the learning of a prediction-and-correction based internal representation of the sensory stimulus.
This work was funder by the Academy of Finland (NEURO program and the Algodam Centre of Excellence).
- Simoncelli E, Olshausen B: Natural image statistics and neural representation. Annual Review of Neuroscience. 2001, 24: 1193-1216. 10.1146/annurev.neuro.24.1.1193.PubMedView ArticleGoogle Scholar
- Olshausen B, Field D: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996, 381: 607-609. 10.1038/381607a0.PubMedView ArticleGoogle Scholar
- Smith E, Lewicki M: Efficient auditory coding. Nature. 2006, 439: 978-982. 10.1038/nature04485.PubMedView ArticleGoogle Scholar
- Vincent BT, Baddeley RJ, Troscianko T, Gilchrist ID: Is the early visual system optimised to be energy efficient?. Network: Computation in Neural Systems. 2006, 16: 175-190. 10.1080/09548980500290047.View ArticleGoogle Scholar
- Gutmann M, Hyvärinen A, Aihara K: Learning encoding and decoding filters for data representation with a spiking neuron. International Joint Conference on Neural Networks (IJCNN2008). 2008Google Scholar
- Gutmann M, Hyvärinen A: Learning reconstruction and prediction of natural stimuli by a population of spiking neurons. European Symposium on Artificial Neural Networks (ESANN2009). 2009-05-12Google Scholar
- Gerstner W, Kistler WK: Spiking Neuron Models. 2002, Cambridge University PressView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd.