Volume 16 Supplement 1

24th Annual Computational Neuroscience Meeting: CNS*2015

Open Access

A hierarchy of time scales supports unsupervised learning of behavioral sequences

BMC Neuroscience201516(Suppl 1):P78

https://doi.org/10.1186/1471-2202-16-S1-P78

Published: 18 December 2015

Playing the piano, speaking or playing tennis are just few examples of behavioral situations in which we need to perform sequences of actions. The neurophysiological mechanisms that underlie the production and learning of such sequences are far from being understood and several crucial issues arise in biologically plausible models: first, there is a huge gap of time scales between the response of single neurons, which is on the order of tens of milliseconds, and common behavioral situations, which usually span several seconds. Moreover, behavioral sequences are often complex, i.e. they cannot be described as Markov chains and thus require to relate distant parts of the sequence. Finally, similar to its biological counterpart, a candidate model should be able to learn new sequences with biologically plausible learning rules.

We devise a simplified model of neural populations with the aim of producing slow sequences of neural activation to correlate with behavioral sequences. We exploit spike frequency adaptation of single neurons to introduce a slow process [1] in the population dynamics in order to fill the gap between different time scales described above. Our model features a hierarchy of time scales inspired by evidence of different time scales among different areas in the brain [2, 3]. This allows a separation of neural coding into varying levels of temporal detail: the sequence produced in a "faster" area will be regulated by the activity of "slower" areas in a hierarchical fashion. This provides a mechanism to deal with non-Markovianity thanks to the longer memory capacity of "slower" areas. Finally, we show that it is possible to learn the appropriate inter-area synaptic connections using biologically plausible learning rules, exploiting the decrease in activity due to adaptation. This approach leads to the development of temporal receptive fields associated to subparts of the desired sequence with hierarchical levels of detail.

Our model constitutes a promising approach to temporal learning, showing how an appropriate neural substrate with a hierarchy of time scales can lead, even without any error or reward signal, to the learning of slow and complex sequences.

Declarations

Acknowledgements

Research was supported by the Swiss National Science Foundation (grant agreement no. 200020_147200).

Authors’ Affiliations

(1)
School of Life Sciences, Brain Mind Institute and School of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne

References

  1. Pozzorini C, Naud R, Mensi S, Gerstner W: Temporal whitening by power-law adaptation in neocortical neurons. Nat Neurosci. 2013, 16 (7): 942-948.PubMedView ArticleGoogle Scholar
  2. Kiebel SJ, Daunizeau J, Friston KJ: A hierarchy of time-scales and the brain. PloS Comput Biol. 2008, 4 (11): e1000209-PubMedPubMed CentralView ArticleGoogle Scholar
  3. Hasson U, Yang E, Vallines I, Heeger D, Rubin N: A hierarchy of temporal receptive windows in human cortex. J Neurosci. 2008, 28 (10): 2539-2550.PubMedPubMed CentralView ArticleGoogle Scholar

Copyright

© Muscinelli and Gerstner 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement