Why noise is useful in functional and neural mechanisms of interval timing?
© Oprisan and Buhusi; licensee BioMed Central Ltd. 2013
Received: 26 January 2013
Accepted: 1 August 2013
Published: 7 August 2013
Skip to main content
© Oprisan and Buhusi; licensee BioMed Central Ltd. 2013
Received: 26 January 2013
Accepted: 1 August 2013
Published: 7 August 2013
The ability to estimate durations in the seconds-to-minutes range - interval timing - is essential for survival, adaptation and its impairment leads to severe cognitive and/or motor dysfunctions. The response rate near a memorized duration has a Gaussian shape centered on the to-be-timed interval (criterion time). The width of the Gaussian-like distribution of responses increases linearly with the criterion time, i.e., interval timing obeys the scalar property.
We presented analytical and numerical results based on the striatal beat frequency (SBF) model showing that parameter variability (noise) mimics behavioral data. A key functional block of the SBF model is the set of oscillators that provide the time base for the entire timing network. The implementation of the oscillators block as simplified phase (cosine) oscillators has the additional advantage that is analytically tractable. We also checked numerically that the scalar property emerges in the presence of memory variability by using biophysically realistic Morris-Lecar oscillators. First, we predicted analytically and tested numerically that in a noise-free SBF model the output function could be approximated by a Gaussian. However, in a noise-free SBF model the width of the Gaussian envelope is independent of the criterion time, which violates the scalar property. We showed analytically and verified numerically that small fluctuations of the memorized criterion time leads to scalar property of interval timing.
Noise is ubiquitous in the form of small fluctuations of intrinsic frequencies of the neural oscillators, the errors in recording/retrieving stored information related to criterion time, fluctuation in neurotransmitters’ concentration, etc. Our model suggests that the biological noise plays an essential functional role in the SBF interval timing.
Although the localization of brain regions involved in interval timing is not yet clear, some progress has been made. For example, both temporal production and temporal perception are strongly connected to striatum and its afferent projections from the substantia nigra pars compacta [14–16]. In addition, it was shown that the firing patterns of striatal neurons peak around a trained criterion time, a pattern consistent with substantial striatal involvement in interval timing . Pharmacological data also suggest a strong basal ganglia involvement in interval timing. Administration of dopaminergic drugs both systemically [13, 18–23] or directly into the anterior portion of the striatum  alters the speed of interval timing. Experiments showed a shift in the perceived time towards earlier times following systemic dopamine (DA) agonists administration (e.g., methamphetamine or cocaine) whereas systemic DA antagonists administration (e.g., haloperidol) shift the response times in the opposite direction (clock pattern). A possible physiological hypothesis is that DA causes internal clock(s) to run faster than normal, therefore, shifting the entire response of the animal earlier than the control [20, 25, 26].
Studies done in humans also support the hypothesis that striatum and its afferents are involved in interval timing [27–33]. Recent fMRI data showed that timing network could involve cortico-striatal loops, including premotor and supplementary motor areas, frontal operculum and dorsolateral prefrontal cortex, and temporal and parietal cortices, as well as the putamen . Imaging studies in humans [28–30, 32], lesion studies in humans [31, 35–37] and rodents [14, 15, 22], and drug studies in rodents [17–20, 22–24, 38] all point towards a central role of the basal ganglia in interval timing. The anatomy of the basal ganglia suggests that information is proceeded through cortico-striato-thalamic loops. Severe deficiencies in reproducing temporal intervals were also found in Parkinson’s patients, therefore, further supporting the hypothesis of basal ganglia involvement in interval timing [36, 39–41]. There are also lesions data suggesting that the timing network is much widely distributed. Lesions of the nucleus basalis magnocellularis, a cholinergic nucleus in the basal forebrain with projections to the frontal cortex, induced a progressive, proportional, delay in peak time response (memory pattern). This effect is believed to be related to altered temporal memories [42, 43] due to change in acetylcholine (ACh) level. Lesions of the frontal cortex produce similar memory patterns , whereas lesions of the hippocampus or fimbria fornix, a basal forebrain cholinergic nucleus with projections to the hippocampus, result in memory effects translated into an advance of the peak time response [42–44]. These experimental findings undoubtedly support the hypothesis of a distributed interval timing neural network.
The connectionist model is among the first attempts to integrate a large collection of experimental findings into a coherent distributed network model of interval timing by Church and Broadbent [45, 46]. They assumed that a set of neural oscillators, probably localized in the prefrontal cortex, determines the peak time using multiple-period discrimination algorithms. In their model, the current phases of oscillators (clock stage) are continually compared against the memorized phases at the reinforcement time (memory stage). The connectionist model successfully duplicated the scalar property and the response form of both peak-interval  and fixed-interval procedures . The connectionist model also presents higher accuracy for intervals near the underlying oscillator period similar to experimental observations [48–50]. However, the connectionist model is limited to timing durations that do not exceed the longest period of the set of oscillators and requires a quite large coefficient of variation .
Another successful distributed network model, called the beat frequency model, uses beats between multiple oscillators to produce a much wider range of durations than the intrinsic periods of individual oscillators [13, 21, 52]. It is assumed that at the beginning of each trial all oscillators are reset and start in phase. At the reinforcement time, the oscillators are read out to determine whether they are spiking (“on” state) or are silent (“off” state). The small group of neurons that spike at the reinforcement time represents the neural code for that particular duration. A temporal prediction is made by a threshold-driven comparison between the number of strengthened neurons currently firing and the number of neurons that fired at the reinforcement time. Miall  conducted numerical simulations using beat frequency model and found a second peak halfway through the criterion duration similar to the “breakpoint” time observed in the peak-interval procedure . In addition, the third highest peak corresponds to 2/3 of the way to the criterion in a manner similar to the breakpoint seen in fixed interval procedures .
In this study, we generalized previous results regarding the quasi-Gaussian shape and the scalar property using the SBF model [13, 21, 52]. Although it was long assumed that the behavioral response curve for peak procedure could be approximated by a Gaussian, here we actually proved theoretically and checked numerically that it is always a Gaussian. Furthermore, we showed that this fact is independent of the type of variability, or biological noise, present in the interval timing network.
We also showed that the scalar property is a universal feature of any SBF model regardless the type of model neurons used and the type of probability distribution functions (pfd) for parameters affected by biological noise. Variability in the SBF model could be ascribed to channel gating fluctuations [55, 56], noisy synaptic transmission , and background network activity [58–60]. Single-cell recordings support the hypothesis that irregular firing in cortical interneurons is determined by the intrinsic stochastic properties (channel noise) [61–63] of individual neurons [64, 65]. At the same time, fluctuations in the presynaptic currents that drive cortical spiking neurons have a significant contribution to the large variability of the interspike intervals [66, 67]. For example, in spinal neurons, synaptic noise alone fully accounts for output variability . In this paper, we are not concerned with the biophysical mechanisms that generated irregular firing of cortical oscillators. We rather investigate if assumed variability in SBF model’s parameters can produce precise and time-scale invariant interval timing.
Within the SBF paradigm we used a simple model of cortical oscillators, i.e., a cosine wave (phase) model (see  and references therein) and showed analytically that it (a) violates the scalar property in the absence of model’s parameters variability (noise), and (b) the output function is always Gaussian and obeys the scalar property regardless the pdf of assumed model’s variability. The above two analytical predictions were numerically confirmed both with the cosine wave model oscillators and with a more biophysically realistic, conductance-based, Morris-Lecar (ML) model neuron [68, 69]. ML model neuron was developed for the giant muscle fiber of barnacles  by combining Hodgkin-Huxley  and FitzHugh-Nagumo [71, 72] models into a voltage-gated calcium channel model with a delayed-rectifier potassium channel. Since then, ML model was successfully used for describing different types of cortical neurons. For example, White et al performed voltage-clamp recordings from entorhinal cortical neurons of mice and calibrated a ML model neuron in which they replaced the calcium current by an instantaneously-activated persistent sodium current. By comparing the results of ML model neuron against experimental data, they found that “this reduction in the number of dependent variables does not alter significantly the behavior of the system.” For this reason, and because the ML model is considered a canonical prototype for widely encountered classes of both deterministic and stochastic neurons , we used ML model in our implementation of the SFB model.
is composed of N osc neural oscillators with frequencies distributed over a range (f 1,f 2) consistent with neurobiological observations [21, 52, 79–81]. The fixed firing frequencies of individual neural oscillators, f i , are equally spaced, i.e, f i =f 1+i·d f with frequency increments d f=(f 2−f 1)/N osc . OSC provides the underlying time base for the interval timing network. In the presence of noise, e.g., ionic channel noise [55, 56, 61–65] or background neural activity from other cortical areas [57–60, 66, 67], a set N f of N osc frequencies, , are generated from a random distribution around f i with a frequency variability x f that obeys a given probability density function pdf f . The output function is an average over all N f distributions of frequencies.
stores a criterion time value, c, memorized during the training process. Both storing and retrieving the criterion time to and from the long-term memory are affected by biological context (brain state, noise, etc.) Therefore, in the presence of noise, a set N c of randomly distributing values are generated with the mean c and variability x c according to a given probability density function pdf c . The output function averages over all N c randomly distributed values of the criterion time c.
relates the internal perception of time with external actions.
In order to implement the decision-making process ascribed to basal ganglia, we define a set of numbers (weights) that represent the state of each oscillator. The weight w(k,c) encodes the state of k t h neural oscillator from the OSC block at the reinforcement (criterion) time. Although it is not the only possibility, the “state” of the brain at the reinforcement time could be given, for example, by the phases or the amplitudes of all neural oscillators in OSC. The OUT block estimates the “closeness” between the current state of the brain represented by the running weights w(k,t) and the memorized weights at the reinforcement time w(k,c). Among many possible implementations of the “closeness”, we chose the projection of the running weights w(k,t) along the vector of reference weights w(k,c) (the dot product of vectors w(k,c) and w(k,t)).
mimics the experimentally observed effects of neuromodulators on interval timing. The actual mechanism implemented in this SBF model directly changes the firing frequency of all neurons in the OSC block proportional to the level of neuromodulator. In this implementation of the SBF model, we used the MOD block as a “start gun” that resets the OSC block at the beginning of each trial such that all neural oscillators state in phase. Elsewhere [82–85], we showed that a more detailed implementation of the DA modulation in the SBF model correctly reproduces the clock patterns: immediate change in timing and gradual re-calibration under the drug, immediate re-bound in the opposite direction and gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects as observed in experiments (see, for example, ). Similarly, we showed [82–85] that manipulations of ACh level that modulates the long-term memory lead to memory patterns: gradual change in timing on-drug, gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects (see  for comparison with experiments).
In order to gain insight into the functionality of the SBF block model, we initially assumed that the time base is provided by cosine (phase) oscillators. A phase oscillator is a mathematical abstraction obtained by reducing a complex and detailed mathematical model of a biological neuron to a single parameter - the firing phase measured with respect to an arbitrary reference [86–90]. The simplest possible oscillatory behavior is represented by cos(2π f t), where the argument of cosine is called the phase of oscillation, t is the temporal variable, and f is the fixed firing frequency of the oscillator. Phase oscillators represent a significant class of neural oscillators and all complex neural oscillators can be reduced to a phase oscillator near bifurcation points .
and found no significant difference in the properties of the output function.
Based on (3), we computed the absolute value of the cosine of the angle between w(k,t) and w(k,c), which smoothly varies between unity, when the current state of the brain coincides with the one memorized at the reinforcement time, and zero, when there is no overlap between them. Other common and equally appealing choices in computational neuroscience, but a bit more expensive from a computational point of view, are sigmoidal functions or double exponentials, both of which are often used to mimic experimentally measured activation/inactivation curves with smooth transitions between “off” (zero) and “on” (unity) states.
The pdf z of the new stochastic variable z(x) is related to the pdf x of the criterion time p X (x) through well-known relationship [92, 93]: p Z (z)=p X (h−1(z))|d x/d z|. Based on the central limit theorem, the output function (7), which is a sum over N c stochastic variables with the pdf Z (z), is always a Gaussian regardless the pdf of the criterion time.
and y 0=σ/(2c θ) with θ≠0. If a solution y 0 exists for Eq. (12), then the width σ of the output function must obey the scalar property because σ=2c θ y 0 increases linearly with the criterion time c.
We carried out numerical simulations using cosine model with N c different criterion times distributed around c. Figure 3C shows the output of the SBF model when N c criteria are drawn from a uniform distribution centered on c. For the particular realization of the criteria with uniform distribution, it results form Figure 3C that the width of the Gaussian envelope (dashed line) increases with c. Figure 3D shows that the width of the Gaussian fit scales linearly with the criterion time both for uniformly distributed criteria (solid rhombs in Figure 3D) and normal distribution (solid square in Figure 3D). These results support our theoretical prediction that the scalar property is valid regardless the pdf of memory variability.
Cosine oscillators were extensively used in numerical simulations of interval timing models with great success [13, 21, 52]. Our current theoretical predictions and numerical simulations of SBF model with cosine oscillators are in good agreement with interval timing experiments. Cosine model has a series of advantages: (1) it is mathematically convenient and computationally efficient, (2) it is close to actual voltage traces recorded from neural oscillators that fire close to a critical (bifurcation) point, and (3) it helps us understand the effects of different types of variabilities (noises) on the output of the SBF interval timing model. However, the cosine waveforms are not physiologically realistic. Furthermore, abstract cosine waveforms, cos(2π f t), cannot be linked with the biophysics involved in action potential firing, such as the density of ionic channels, membrane capacitance, etc. Another consequence of these shortcomings is that the cosine waveform cannot account for the effect of neuromodulators since there is no biophysical mechanism behind the cosine oscillators with fixed frequency. Therefore, as highlighted in the Introduction, we replaced the cosine oscillator with a ML model neuron [68, 69] for two main reasons (see Appendix for model equations): 1) ML model neuron is one of the simplest and often used as a realistic cortical oscillator model [74, 94] that includes conductance-based mechanisms similar to Hodgkin-Huxley model  involving potassium and calcium channels and, 2) by changing a relatively small subset of model’s parameters, ML model neuron can act as a Type 1 excitable cell (fast spiking)  or a Type 2 excitable cell (slowly sinusoidal envelope close to a cosine waveform) .
In the absence of any variability, our numerical results show that the width of the output function of the SBF model with ML oscillators does not change with criterion time, therefore, violating the scaling property. This finding is not surprising and it was predicted analytically in the case of cosine models. Since any periodic waveform, such as the action potential of an endogenously spiking neuron, can be decomposed in discrete cosine components, we conjectured that “no variability = no scalar property” based on the theoretical results obtained with cosine oscillators. We also noticed that the width of the output function decreases with the increase in the number of neural oscillators. Based on our cosine oscillator results, this observation is also predicable since the output function is the discrete Fourier transform of the reference weights vector w(k,c). Since the temporal and frequency domains are conjugated through a Fourier transform , the product Δ f Δ t is constant. Therefore, increasing the frequency resolution Δ f (by increasing the number of neural oscillators recruited for interval timing tasks over the same frequency range) decreases the temporal spread of the output function and makes the behavioral response more localized.
The fact that noise, whether as channel noise [61–63] or background synaptic activity [59, 60] is a crucial ingredient that often leads to new and unexpected effects is not limited to interval timing. For example, the noise facilitates signal transduction  and enhances signal detection by sensory systems . The noise also induces synchronization of neural oscillations in olfactory bulb mitral cells  or in large networks cortical fast-spiking cells . Cortical neurons have a large coefficient of variation of the interspike interval [64, 65] which can be modeled at different levels of details from an explicit ML stochastic models of ionic channels to phenomenological potential-dependent averages . In this paper, we opted for a phenomenological approach to modeling variability in the interspike interval through a fluctuating bias current.
Interval timing models vary largely with respect to the fundamental assumptions and the hypothesized mechanisms by which temporal processing is explained. In addition, interval timing model attempt explaining time-scale invariance, or drug effects differently. Among the most prominent models of interval timing we cite pacemaker/accumulator processes [4–6], sequences of behaviors , pure sine oscillators [13, 16, 21, 45], memory traces [103–107], or cell and network-level models [108, 109]. Both neurometric functions from single neurons and ensemble of neurons successfully paralleled the psychometric functions for the to-be-timed intervals shorter than one second . Interacting populations that balance LTP and LTD mechanisms are thought to modulate the firing rate of single-cell with the end effect at the population level that the adaptation leads to a linear decay of the firing rate over time . Therefore, the linear relationship between time and the number of clock ticks of the pacemaker-accumulator model in the SET of interval timing  was translated into a linearly decaying firing rate model that maps time and variable firing rate.
By and large, to address time-scale invariance current behavioral theories assume convenient computations, rules, or coding schemes. Scalar timing is explained as either deriving from computation of ratios of durations -[6, 111], adaptation of the speed at which perceived time flows , or from processes and distributions that conveniently scale-up in time [45, 103, 105, 106]. Some neurobiological models share computational assumptions with behavioral models and continue to address time-scale invariance by specific computations or embedded linear relationships . Some assume that timing involves neural integrators capable of linearly ramping up their firing rate in time , while others assume LTP/LTD processes whose balance leads to a linear decay of the firing rate in time . It is unclear whether such models can account for time-scale invariance in a large range of behavioral or neurophysiological manipulations.
For example, Killeen and Taylor (1988) explained time-scale invariance of timing in terms of noisy information transfer during counting. Similarly, here, we explained time-scale invariance of timing in terms of noisy coincidence detection during timing. Our theoretical predictions based on an SBF model show that time-scale invariance emerges as the property of a (very) large and noisy network. Furthermore, our results regarding the effect of noise on interval timing support and extend the speculation  by which an SBF model requires at least one source of variance (noise) to address time-scale invariance. Rather than being a signature of higher-order cognitive processes or specific neural computations related to timing, time-scale invariance naturally emerges in a massively-connected brain from the intrinsic noise of neurons and circuits [1, 108]. This provides the simplest explanation for the ubiquity of scale invariance of interval timing in a large range of behavioral, lesion, and pharmacological manipulations.
We investigated both analytically and numerically the properties of the output function generated by the SBF model and found that the output function mimics behavioral responses of animals performing peak interval procedures. We found analytically that, in the absence of any kind of variability in the parameters of the SBF model, the width of the output function only depends on the number of oscillators and the range of frequencies they cover. Therefore, in the absence of parameter variability the scalar property is violated.
We showed that if parameter variability is allowed, then the output function of the SBF model with cosine oscillators is always Gaussian, which is a consequence of the central limit theorem, regardless the pdf of the fluctuating parameter(s). Moreover, we found that the scalar property is also preserved regardless the pdf of the fluctuating parameter(s).
We also conjectured that the following two statements are always true in any noisy SBF implementation: (1) the output function is always Gaussian, which is a consequence of central limit theorem, and (2) the scalar property is valid regardless the pdf of the fluctuating parameter(s). The justification for such general statements is that any periodic waveform of an endogenously spiking neuron can be decomposed into a sum of cosine waves. Based on our theoretical proof that any SBF model with noisy cosine oscillators has a Gaussian output function that obeys the scalar property, we concluded that the biophysical details of the oscillators that generate the train of periodic action potentials are not relevant for the shape of the output function or the validity of the scalar property. Our numerical tests of the SBF model with biophysically realistic periodically spiking ML model neurons showed that the above two conjectures are valid.
The pairs (x 0,y 0) are determined by the number of oscillators N osc in the network and the range of frequencies covered. However, since there is no dependence of (x 0,y 0) pair on the criterion time the output function is simply centered on t=c but otherwise totally independent on c. This means that the width σ out of the output function envelope depends only on the range of oscillators’ frequencies f 1 and f 2=N osc d f and the number of oscillators, but is independent of the criterion time, therefore, violating the scalar property.
where x 1 is the membrane potential, x 2 is the slow potassium activation and all ionic currents are described by I x =g x (x 1−E x ), where g x is the conductance of the voltage gated channel x and E x is the corresponding reversal potential. In particular, the calcium current is I Ca =g Ca m ∞ (x 1)(x 1−E Ca ), the potassium current is I K =g K x 2(x 1−E K ), and the leak current is I L =g L (x 1−V L ). The reversal potentials for calcium, potassium and leak currents are E Ca =1.0,E K =−0.7,E L =−0.5, respectively. The steady state activation function for calcium channels is m ∞ (x 1)=1+ tanh((x 1−V 1)/V 2))/2, where V 1=−0.01,V 2=0.15, the steady state activation function for potassium channels is w ∞ (x 1)=(1+ tanh((x 1−V 3)/V 4])/2 where V 3=0.1,V 4=0.145, the inverse time constant of potassium channels is λ 0(x 1)= cosh((x 1−V 3)/V 4/2), the potassium and leak conductances are g K =2.0,g L =0.5, respectively, and the ξ=1.0/3.0.
The two control parameters that can switch the ML model from a Type 1 excitable cell  to a Type 2 are the calcium conductance g Ca and the bias current I 0. If g Ca =1.0 and 0.083<I 0<0.242 the equations (15) describe what was classified by A.L. Hodgkin as Type 1 excitable cells. If g Ca =0.5 and 0.303<I 0<0.138 the equations (15) describe a Type 2 excitable cells. In our simulations, we used a Type 2 ML model neuron that has a membrane potential shape very close to a cosine waveform.
This research was supported by the CAREER award IOS 1054914 from the National Science Foundation to SAO and by the National Institutes of Health grants MH65561 and MH73057 to CVB.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.