Reservoir of neurons with adaptive time constants: a hybrid model for robust motor-sensory temporal processing
BMC Neuroscience volume 15, Article number: P9 (2014)
The ability to precisely quantify time on the scale of hundreds of milliseconds is critical towards the processing of complex sensory and motor patterns. However, the natures of neural mechanisms for temporal processing (at this scale) in the brain are mostly unknown. Based on experimental data (psychophysics, cell cultures, electrophysiology) and theoretical studies, it is largely debated whether dedicated circuits or intrinsic mechanisms of neural circuits underlie the timing process . One specific type of timing model, namely state-dependent networks (SDN) , shows that time is encoded in the temporal patterns of activity of neural populations and emerges from the internal dynamics of recurrent networks. This can be achieved without the need of dedicated timing units. However, such intrinsic models in their present form have difficulty accounting for crossmodal transfer . In contrast, recent experimental evidence indicates that medial premotor cortical neurons of behaving monkeys show specific interval tuning across modalities (auditory and visual) . In this work we propose a hybrid model, making the hypothesis that dedicated interval tuning mechanisms of individual neurons augment the intrinsic dynamics of large recurrent networks (dynamic reservoir). Using a network model of rate-coded neurons starting with random initialization of synaptic connections, we propose a learning rule based on local active information storage (LAIS)  to adapt neuronal time constants with respect to the input stimuli to the network. Measured at each spatiotemporal location of the reservoir, LAIS gives a probabilistic measure of the amount of information in the previous state of the neuron that is relevant in predicting the next state. Interestingly high LAIS regions in the network correlate to significant events in time (intervals) of the driving stimulus. Furthermore, we combine this with mutual information driven intrinsic plasticity scheme in order to stabilize chaotic activity in the network. Incoming input drives the network which, in turn, is connected to readout neurons (Figure 1.A) that display the learned behavior for temporally dependent sensory motor tasks. Reservoir-to-output connections can be adapted using both supervised and reward modulated learning rules. Using single and multiple interval discrimination tasks, we show that our network reproduces (across modalities) a linear increase in temporal variability with increase in interval duration. This correlation is also observed in experimental data . Furthermore we demonstrate that our dedicated timing mechanism complements the inherent transient dynamics of the network by successfully learning complex time dependent motor behaviors; like handwriting generation (Figure 1.B and C), locomotion pattern transformation and temporal memory tasks. In essence, our hybrid model demonstrates that time can be encoded by a combination of dedicated and intrinsic mechanisms with the possibility to ‘learn’ the temporal structure of incoming stimuli .
Ivry RB, Schlerf JE: Dedicated and intrinsic models of time perception. Trends Cogn. Sci. 2008, 12: 273-280. 10.1016/j.tics.2008.04.002.
Buonomano DV, Maass W: State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 2009, 10: 113-125. 10.1038/nrn2558.
Merchant H, Perez O, Zarco W, Gamez J: Interval tuning in the primate medial premotor cortex as a general timing mechanism. J. Neurosci. 2013, 33: 9082-9096. 10.1523/JNEUROSCI.5513-12.2013.
Wibral M, Lizier JT, Vögler S, Priesemann V, Galuske R: Local active information storage as a tool to understand distributed neural information processing. Front. Neuroinform. 2014, 8: 1-
Johnson HA, Goel A, Buonomano DV: Neural dynamics of in vitro cortical networks reflects experienced temporal patterns. Nat. Neurosci. 2010, 13: 917-919. 10.1038/nn.2579.
About this article
Cite this article
Dasgupta, S., Manoonpong, P. & Wörgötter, F. Reservoir of neurons with adaptive time constants: a hybrid model for robust motor-sensory temporal processing. BMC Neurosci 15 (Suppl 1), P9 (2014). https://doi.org/10.1186/1471-2202-15-S1-P9
- Hybrid Model
- Recurrent Network
- Intrinsic Mechanism
- Spatiotemporal Location
- Crossmodal Transfer