- Research article
- Open Access
Why noise is useful in functional and neural mechanisms of interval timing?
BMC Neurosciencevolume 14, Article number: 84 (2013)
The ability to estimate durations in the seconds-to-minutes range - interval timing - is essential for survival, adaptation and its impairment leads to severe cognitive and/or motor dysfunctions. The response rate near a memorized duration has a Gaussian shape centered on the to-be-timed interval (criterion time). The width of the Gaussian-like distribution of responses increases linearly with the criterion time, i.e., interval timing obeys the scalar property.
We presented analytical and numerical results based on the striatal beat frequency (SBF) model showing that parameter variability (noise) mimics behavioral data. A key functional block of the SBF model is the set of oscillators that provide the time base for the entire timing network. The implementation of the oscillators block as simplified phase (cosine) oscillators has the additional advantage that is analytically tractable. We also checked numerically that the scalar property emerges in the presence of memory variability by using biophysically realistic Morris-Lecar oscillators. First, we predicted analytically and tested numerically that in a noise-free SBF model the output function could be approximated by a Gaussian. However, in a noise-free SBF model the width of the Gaussian envelope is independent of the criterion time, which violates the scalar property. We showed analytically and verified numerically that small fluctuations of the memorized criterion time leads to scalar property of interval timing.
Noise is ubiquitous in the form of small fluctuations of intrinsic frequencies of the neural oscillators, the errors in recording/retrieving stored information related to criterion time, fluctuation in neurotransmitters’ concentration, etc. Our model suggests that the biological noise plays an essential functional role in the SBF interval timing.
The capability of perceiving and using the passage of time in the seconds-to-minutes range (interval timing) is essential for survival and adaptation, and its impairment leads to severe cognitive and motor dysfunctions [1–3]. In most species, interval timing is both accurate and time-scale invariant, or simply scalar, in that the error in time estimation is proportional to the estimated duration [4–6]. When timing a 30s interval (Figure 1A), responses follow a quasi-Gaussian distribution around the 30s target duration. Furthermore, when timing a 90s interval (Figure 1C), responses also follow a quasi-Gaussian distribution around the 90s target duration. The scalar property is evident in that normalizing the response functions by the target duration and by the maximum response rate yields superimposition of response functions (Figure 1B). The time-scalar invariance property of interval timing is ubiquitous in many species from invertebrates such as bees , to many vertebrates, such as fish , birds , and mammals such as rats , mice  and humans .
Although the localization of brain regions involved in interval timing is not yet clear, some progress has been made. For example, both temporal production and temporal perception are strongly connected to striatum and its afferent projections from the substantia nigra pars compacta [14–16]. In addition, it was shown that the firing patterns of striatal neurons peak around a trained criterion time, a pattern consistent with substantial striatal involvement in interval timing . Pharmacological data also suggest a strong basal ganglia involvement in interval timing. Administration of dopaminergic drugs both systemically [13, 18–23] or directly into the anterior portion of the striatum  alters the speed of interval timing. Experiments showed a shift in the perceived time towards earlier times following systemic dopamine (DA) agonists administration (e.g., methamphetamine or cocaine) whereas systemic DA antagonists administration (e.g., haloperidol) shift the response times in the opposite direction (clock pattern). A possible physiological hypothesis is that DA causes internal clock(s) to run faster than normal, therefore, shifting the entire response of the animal earlier than the control [20, 25, 26].
Studies done in humans also support the hypothesis that striatum and its afferents are involved in interval timing [27–33]. Recent fMRI data showed that timing network could involve cortico-striatal loops, including premotor and supplementary motor areas, frontal operculum and dorsolateral prefrontal cortex, and temporal and parietal cortices, as well as the putamen . Imaging studies in humans [28–30, 32], lesion studies in humans [31, 35–37] and rodents [14, 15, 22], and drug studies in rodents [17–20, 22–24, 38] all point towards a central role of the basal ganglia in interval timing. The anatomy of the basal ganglia suggests that information is proceeded through cortico-striato-thalamic loops. Severe deficiencies in reproducing temporal intervals were also found in Parkinson’s patients, therefore, further supporting the hypothesis of basal ganglia involvement in interval timing [36, 39–41]. There are also lesions data suggesting that the timing network is much widely distributed. Lesions of the nucleus basalis magnocellularis, a cholinergic nucleus in the basal forebrain with projections to the frontal cortex, induced a progressive, proportional, delay in peak time response (memory pattern). This effect is believed to be related to altered temporal memories [42, 43] due to change in acetylcholine (ACh) level. Lesions of the frontal cortex produce similar memory patterns , whereas lesions of the hippocampus or fimbria fornix, a basal forebrain cholinergic nucleus with projections to the hippocampus, result in memory effects translated into an advance of the peak time response [42–44]. These experimental findings undoubtedly support the hypothesis of a distributed interval timing neural network.
The connectionist model is among the first attempts to integrate a large collection of experimental findings into a coherent distributed network model of interval timing by Church and Broadbent [45, 46]. They assumed that a set of neural oscillators, probably localized in the prefrontal cortex, determines the peak time using multiple-period discrimination algorithms. In their model, the current phases of oscillators (clock stage) are continually compared against the memorized phases at the reinforcement time (memory stage). The connectionist model successfully duplicated the scalar property and the response form of both peak-interval  and fixed-interval procedures . The connectionist model also presents higher accuracy for intervals near the underlying oscillator period similar to experimental observations [48–50]. However, the connectionist model is limited to timing durations that do not exceed the longest period of the set of oscillators and requires a quite large coefficient of variation .
Another successful distributed network model, called the beat frequency model, uses beats between multiple oscillators to produce a much wider range of durations than the intrinsic periods of individual oscillators [13, 21, 52]. It is assumed that at the beginning of each trial all oscillators are reset and start in phase. At the reinforcement time, the oscillators are read out to determine whether they are spiking (“on” state) or are silent (“off” state). The small group of neurons that spike at the reinforcement time represents the neural code for that particular duration. A temporal prediction is made by a threshold-driven comparison between the number of strengthened neurons currently firing and the number of neurons that fired at the reinforcement time. Miall  conducted numerical simulations using beat frequency model and found a second peak halfway through the criterion duration similar to the “breakpoint” time observed in the peak-interval procedure . In addition, the third highest peak corresponds to 2/3 of the way to the criterion in a manner similar to the breakpoint seen in fixed interval procedures .
In this study, we generalized previous results regarding the quasi-Gaussian shape and the scalar property using the SBF model [13, 21, 52]. Although it was long assumed that the behavioral response curve for peak procedure could be approximated by a Gaussian, here we actually proved theoretically and checked numerically that it is always a Gaussian. Furthermore, we showed that this fact is independent of the type of variability, or biological noise, present in the interval timing network.
We also showed that the scalar property is a universal feature of any SBF model regardless the type of model neurons used and the type of probability distribution functions (pfd) for parameters affected by biological noise. Variability in the SBF model could be ascribed to channel gating fluctuations [55, 56], noisy synaptic transmission , and background network activity [58–60]. Single-cell recordings support the hypothesis that irregular firing in cortical interneurons is determined by the intrinsic stochastic properties (channel noise) [61–63] of individual neurons [64, 65]. At the same time, fluctuations in the presynaptic currents that drive cortical spiking neurons have a significant contribution to the large variability of the interspike intervals [66, 67]. For example, in spinal neurons, synaptic noise alone fully accounts for output variability . In this paper, we are not concerned with the biophysical mechanisms that generated irregular firing of cortical oscillators. We rather investigate if assumed variability in SBF model’s parameters can produce precise and time-scale invariant interval timing.
Within the SBF paradigm we used a simple model of cortical oscillators, i.e., a cosine wave (phase) model (see  and references therein) and showed analytically that it (a) violates the scalar property in the absence of model’s parameters variability (noise), and (b) the output function is always Gaussian and obeys the scalar property regardless the pdf of assumed model’s variability. The above two analytical predictions were numerically confirmed both with the cosine wave model oscillators and with a more biophysically realistic, conductance-based, Morris-Lecar (ML) model neuron [68, 69]. ML model neuron was developed for the giant muscle fiber of barnacles  by combining Hodgkin-Huxley  and FitzHugh-Nagumo [71, 72] models into a voltage-gated calcium channel model with a delayed-rectifier potassium channel. Since then, ML model was successfully used for describing different types of cortical neurons. For example, White et al performed voltage-clamp recordings from entorhinal cortical neurons of mice and calibrated a ML model neuron in which they replaced the calcium current by an instantaneously-activated persistent sodium current. By comparing the results of ML model neuron against experimental data, they found that “this reduction in the number of dependent variables does not alter significantly the behavior of the system.” For this reason, and because the ML model is considered a canonical prototype for widely encountered classes of both deterministic and stochastic neurons , we used ML model in our implementation of the SFB model.
We introduced a minimal block diagram that mimics the contributions of some of the neuroanatomical regions known to be involved in interval timing as identified in the Introduction. The schematic diagram includes the following blocks (see Figure 2). An oscillator block (OSC), presumably mimicking the neural oscillators localized in the prefrontal cortex area . A memory block (MEM), presumably mimicking the activity associated with the nucleus basalis magnocellularis [42, 43], frontal cortex , and/or hippocampus or fimbria fornix [42–44]. Its role is to stores the information about the state of the brain at the reinforcement time. A decision block (OUT), presumably mimicking the striatal spiny neurons that by integrating a very large number of different inputs and responding selectively to particular reinforced patterns [75–77]. Finally, a neuromodulator block (MOD) that mimics the modulation of cortical and thalamic-induced activity of the striatal spiny neurons. The MOD block also modulates the threshold for coherent activity detection due to dopamine release from substantia niagra pars compacta .
The oscillator block (OSC)
is composed of N osc neural oscillators with frequencies distributed over a range (f1,f2) consistent with neurobiological observations [21, 52, 79–81]. The fixed firing frequencies of individual neural oscillators, f i , are equally spaced, i.e, f i =f1+i·d f with frequency increments d f=(f2−f1)/N osc . OSC provides the underlying time base for the interval timing network. In the presence of noise, e.g., ionic channel noise [55, 56, 61–65] or background neural activity from other cortical areas [57–60, 66, 67], a set N f of N osc frequencies, , are generated from a random distribution around f i with a frequency variability x f that obeys a given probability density function pdf f . The output function is an average over all N f distributions of frequencies.
The memory block (MEM)
stores a criterion time value, c, memorized during the training process. Both storing and retrieving the criterion time to and from the long-term memory are affected by biological context (brain state, noise, etc.) Therefore, in the presence of noise, a set N c of randomly distributing values are generated with the mean c and variability x c according to a given probability density function pdf c . The output function averages over all N c randomly distributed values of the criterion time c.
The decision/output block (OUT)
relates the internal perception of time with external actions.
In order to implement the decision-making process ascribed to basal ganglia, we define a set of numbers (weights) that represent the state of each oscillator. The weight w(k,c) encodes the state of kth neural oscillator from the OSC block at the reinforcement (criterion) time. Although it is not the only possibility, the “state” of the brain at the reinforcement time could be given, for example, by the phases or the amplitudes of all neural oscillators in OSC. The OUT block estimates the “closeness” between the current state of the brain represented by the running weights w(k,t) and the memorized weights at the reinforcement time w(k,c). Among many possible implementations of the “closeness”, we chose the projection of the running weights w(k,t) along the vector of reference weights w(k,c) (the dot product of vectors w(k,c) and w(k,t)).
The neuromodulator block (MOD)
mimics the experimentally observed effects of neuromodulators on interval timing. The actual mechanism implemented in this SBF model directly changes the firing frequency of all neurons in the OSC block proportional to the level of neuromodulator. In this implementation of the SBF model, we used the MOD block as a “start gun” that resets the OSC block at the beginning of each trial such that all neural oscillators state in phase. Elsewhere [82–85], we showed that a more detailed implementation of the DA modulation in the SBF model correctly reproduces the clock patterns: immediate change in timing and gradual re-calibration under the drug, immediate re-bound in the opposite direction and gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects as observed in experiments (see, for example, ). Similarly, we showed [82–85] that manipulations of ACh level that modulates the long-term memory lead to memory patterns: gradual change in timing on-drug, gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects (see  for comparison with experiments).
The SBF model with cosine oscillators
In order to gain insight into the functionality of the SBF block model, we initially assumed that the time base is provided by cosine (phase) oscillators. A phase oscillator is a mathematical abstraction obtained by reducing a complex and detailed mathematical model of a biological neuron to a single parameter - the firing phase measured with respect to an arbitrary reference [86–90]. The simplest possible oscillatory behavior is represented by cos(2π f t), where the argument of cosine is called the phase of oscillation, t is the temporal variable, and f is the fixed firing frequency of the oscillator. Phase oscillators represent a significant class of neural oscillators and all complex neural oscillators can be reduced to a phase oscillator near bifurcation points .
In our implementation of the SBF model, the reference weights w(k,c), which represent the state of the brain at the reinforcement (criterion) time are normalized values of the state of neuron k:
where the sum is considered over all stored criteria that fluctuate around c due to memory noise. The normalization factor is the maximum value over all states , in which case the reference weight is bounded −1<w(k,c)<1. We also tested positively defined weights given by:
and found no significant difference in the properties of the output function.
In this implementation of the SBF model, OUT works as a phase detector, i.e., if the current vector of weights w(k,t) at the current phases (time) matches the reference weights vector w(k,c) at criterion time, c, then a strong response is delivered, otherwise the response is negligible. In order to generate a response, the OUT block computes the current weights w(k,t) for each oscillator according to (1), or (2), and projects them along the reference weights vector w(k,c):
Based on (3), we computed the absolute value of the cosine of the angle between w(k,t) and w(k,c), which smoothly varies between unity, when the current state of the brain coincides with the one memorized at the reinforcement time, and zero, when there is no overlap between them. Other common and equally appealing choices in computational neuroscience, but a bit more expensive from a computational point of view, are sigmoidal functions or double exponentials, both of which are often used to mimic experimentally measured activation/inactivation curves with smooth transitions between “off” (zero) and “on” (unity) states.
Cosine oscillators with no variability
We gained significant insight into the dynamics of SBF model by assuming no noise (variability) in any of the model’s parameters. According to (1), the state of the OSC bock at the reinforcement time, i.e., the reference weights w(k,c), is the set of the normalized amplitudes of the kth phase (cosine) oscillator. According to (3), the output function of the SBF model with noiseless cosine oscillators is:
The output function (5) has two symmetric and strong peaks at t=±c, of which we only retain the first one that has a sharp output when t→c. We found that 1/2s i n(π N osc d f(t−c))c o s(π(2f1+N osc d f)(t−c))/s i n(π d f(t−c)) approaches 1/2N osc as t→c, which is in agreement with numerical simulations carried out for a network of 1000 noiseless phase oscillators (see Figure 3). Figure 3A shows the numerically generated output function of the SBF model with noiseless phase oscillators for three memorized criteria, i.e., 30s, 60s, and 90s. Our numerical simulations show that the response of the SBF model peaks when the pattern of input activity w(k,t) “lines-up” or “coincides” with the one stored at the reinforcement time, c, i.e., this SBF model is able to produce precise interval timing. The shape of the output function at each criterion time (see Figure 3A) is captured by the sinc function e n v e l o p e(t)=s i n(π N osc d f(t−c))/s i n(π d f(t−c)), which peaks at t=c (see Eq. (5)). The width of the sinc envelope above is the solution of the equation e n v e l o p e(c−w i d t h/2)=1/2e n v e l o p e(c), i.e, s i n(π N osc d f w i d t h/2)/s i n(π d f w i d t h/2)=1/2N osc , which shows that the width of the envelope is independent of the criterion time, i.e., it violates time-scale invariance property of interval timing. We conducted numerical simulations with various to-be-timed criteria (see Figure 3B) and found that the width of the output is indeed constant rather than increasing proportionally to the criterion time as required by time-scale invariance property of interval timing. In conclusion, a noiseless SBF model is accurate (peaks at criterion time as seen in Figure 3A), but does not exhibit time-scale invariance (the width of the output does not scale-up with the criterion time as seen in Figure 3B).
Cosine oscillators with arbitrary memory variability
As mentioned in the Introduction, biological noise is ubiquitous both as channel noise affecting the dynamics of individual oscillators [55, 56, 61–65] and as stochastic synaptic inputs or network background activity [57–60, 66, 67]. In this implementation of the SBF model, we investigated the effect of criterion time (memory) variability due to noisy storage and retrieval of the criterion time on scalar timing. We found that regardless the pdfs of the stochastic variables involved, the output function is (a) always Gaussian and (b) obeys time-scale invariance property. To prove analytically our conjectures, let us assume only criterion time variability and rewrite the output function (4) as follows:
We only considered the physically realizable first term centered at t=+c, which lead to:
where a j =π(t−c j ). In the presence of memory variability, the criterion time is a stochastic variable c j =c(1+x j ) where x has a p d f p X (x). Using pdf transformation rules [92, 93], we found the pdf of the new stochastic variable in (7):
The pdf z of the new stochastic variable z(x) is related to the pdf x of the criterion time p X (x) through well-known relationship [92, 93]: p Z (z)=p X (h−1(z))|d x/d z|. Based on the central limit theorem, the output function (7), which is a sum over N c stochastic variables with the pdf Z (z), is always a Gaussian regardless the pdf of the criterion time.
What about the time-scale invariance property? Is this feature of the output function still preserved regardless the pdf of the criterion time? Based on (8), we estimated the time-dependent output function by averaging over the criterion time fluctuations:
where the range (x min ,x max ) depends on the type of pdf X (x). Based on the first mean theorem for integrals, there exists a value x min <θ<x max such that (9) becomes:
To compute the width of the output function we introduced the dimensionless variable y=(t−c)/c θ. The width is the value y0=(t0−c)/c θ at which the amplitude of the output function (10) is half its maximum value:
Using t0=c+σ/2, where σ is the half-width of the output function (10), the equation (11) becomes:
and y0=σ/(2c θ) with θ≠0. If a solution y0 exists for Eq. (12), then the width σ of the output function must obey the scalar property because σ=2c θ y0 increases linearly with the criterion time c.
We carried out numerical simulations using cosine model with N c different criterion times distributed around c. Figure 3C shows the output of the SBF model when N c criteria are drawn from a uniform distribution centered on c. For the particular realization of the criteria with uniform distribution, it results form Figure 3C that the width of the Gaussian envelope (dashed line) increases with c. Figure 3D shows that the width of the Gaussian fit scales linearly with the criterion time both for uniformly distributed criteria (solid rhombs in Figure 3D) and normal distribution (solid square in Figure 3D). These results support our theoretical prediction that the scalar property is valid regardless the pdf of memory variability.
The SBF with biophysically realistic model oscillators
Cosine oscillators were extensively used in numerical simulations of interval timing models with great success [13, 21, 52]. Our current theoretical predictions and numerical simulations of SBF model with cosine oscillators are in good agreement with interval timing experiments. Cosine model has a series of advantages: (1) it is mathematically convenient and computationally efficient, (2) it is close to actual voltage traces recorded from neural oscillators that fire close to a critical (bifurcation) point, and (3) it helps us understand the effects of different types of variabilities (noises) on the output of the SBF interval timing model. However, the cosine waveforms are not physiologically realistic. Furthermore, abstract cosine waveforms, cos(2π f t), cannot be linked with the biophysics involved in action potential firing, such as the density of ionic channels, membrane capacitance, etc. Another consequence of these shortcomings is that the cosine waveform cannot account for the effect of neuromodulators since there is no biophysical mechanism behind the cosine oscillators with fixed frequency. Therefore, as highlighted in the Introduction, we replaced the cosine oscillator with a ML model neuron [68, 69] for two main reasons (see Appendix for model equations): 1) ML model neuron is one of the simplest and often used as a realistic cortical oscillator model [74, 94] that includes conductance-based mechanisms similar to Hodgkin-Huxley model  involving potassium and calcium channels and, 2) by changing a relatively small subset of model’s parameters, ML model neuron can act as a Type 1 excitable cell (fast spiking)  or a Type 2 excitable cell (slowly sinusoidal envelope close to a cosine waveform) .
ML oscillators with no variability
In the absence of any variability, our numerical results show that the width of the output function of the SBF model with ML oscillators does not change with criterion time, therefore, violating the scaling property. This finding is not surprising and it was predicted analytically in the case of cosine models. Since any periodic waveform, such as the action potential of an endogenously spiking neuron, can be decomposed in discrete cosine components, we conjectured that “no variability = no scalar property” based on the theoretical results obtained with cosine oscillators. We also noticed that the width of the output function decreases with the increase in the number of neural oscillators. Based on our cosine oscillator results, this observation is also predicable since the output function is the discrete Fourier transform of the reference weights vector w(k,c). Since the temporal and frequency domains are conjugated through a Fourier transform , the product Δ f Δ t is constant. Therefore, increasing the frequency resolution Δ f (by increasing the number of neural oscillators recruited for interval timing tasks over the same frequency range) decreases the temporal spread of the output function and makes the behavioral response more localized.
ML oscillators with arbitrary memory variability
The fact that noise, whether as channel noise [61–63] or background synaptic activity [59, 60] is a crucial ingredient that often leads to new and unexpected effects is not limited to interval timing. For example, the noise facilitates signal transduction  and enhances signal detection by sensory systems . The noise also induces synchronization of neural oscillations in olfactory bulb mitral cells  or in large networks cortical fast-spiking cells . Cortical neurons have a large coefficient of variation of the interspike interval [64, 65] which can be modeled at different levels of details from an explicit ML stochastic models of ionic channels to phenomenological potential-dependent averages . In this paper, we opted for a phenomenological approach to modeling variability in the interspike interval through a fluctuating bias current.
In order to maintain the parallel with the cosine (phase) model, we report here only the effect of memory variability on the standard deviation of the Gaussian fit of the output function generated by the SBF model with ML oscillators (see Figure 4). First, we noticed from our numerical simulations that the SBF model with ML neurons is less sensitive to the level of memory noise. For example, a noise level of 0.1% that led to a linear dependence of the standard deviation on the criterion time in the case of the SBF model with cosine oscillators produced no significant change in the width of the output function with ML neurons (Figure 4D). The scalar property is indeed valid (Figure 4D), but it emerges at higher levels of memory variability, which were not even accessible to phase model. The slope of the standard deviation was insignificant 0.001±0.001(R2=0.342) for 0.1% memory variance (Figure 4A), 0.007±0.002(R2=0.789) for 1% variance (Figure 4B), respectively, 0.07±0.01(R2=0.898) for 10% memory variance (Figure 4C). We found that a ten fold increase in memory variability (from 1% to 10%) led to a ten fold increase (from 0.007 to 0.07) in the slope of the standard deviation versus criterion time. This result suggests that for the SBF model with ML oscillators σ output ∝σ c c as we predicted and already checked for the SBF model with phase oscillators.
Interval timing models vary largely with respect to the fundamental assumptions and the hypothesized mechanisms by which temporal processing is explained. In addition, interval timing model attempt explaining time-scale invariance, or drug effects differently. Among the most prominent models of interval timing we cite pacemaker/accumulator processes [4–6], sequences of behaviors , pure sine oscillators [13, 16, 21, 45], memory traces [103–107], or cell and network-level models [108, 109]. Both neurometric functions from single neurons and ensemble of neurons successfully paralleled the psychometric functions for the to-be-timed intervals shorter than one second . Interacting populations that balance LTP and LTD mechanisms are thought to modulate the firing rate of single-cell with the end effect at the population level that the adaptation leads to a linear decay of the firing rate over time . Therefore, the linear relationship between time and the number of clock ticks of the pacemaker-accumulator model in the SET of interval timing  was translated into a linearly decaying firing rate model that maps time and variable firing rate.
By and large, to address time-scale invariance current behavioral theories assume convenient computations, rules, or coding schemes. Scalar timing is explained as either deriving from computation of ratios of durations -[6, 111], adaptation of the speed at which perceived time flows , or from processes and distributions that conveniently scale-up in time [45, 103, 105, 106]. Some neurobiological models share computational assumptions with behavioral models and continue to address time-scale invariance by specific computations or embedded linear relationships . Some assume that timing involves neural integrators capable of linearly ramping up their firing rate in time , while others assume LTP/LTD processes whose balance leads to a linear decay of the firing rate in time . It is unclear whether such models can account for time-scale invariance in a large range of behavioral or neurophysiological manipulations.
For example, Killeen and Taylor (1988) explained time-scale invariance of timing in terms of noisy information transfer during counting. Similarly, here, we explained time-scale invariance of timing in terms of noisy coincidence detection during timing. Our theoretical predictions based on an SBF model show that time-scale invariance emerges as the property of a (very) large and noisy network. Furthermore, our results regarding the effect of noise on interval timing support and extend the speculation  by which an SBF model requires at least one source of variance (noise) to address time-scale invariance. Rather than being a signature of higher-order cognitive processes or specific neural computations related to timing, time-scale invariance naturally emerges in a massively-connected brain from the intrinsic noise of neurons and circuits [1, 108]. This provides the simplest explanation for the ubiquity of scale invariance of interval timing in a large range of behavioral, lesion, and pharmacological manipulations.
We investigated both analytically and numerically the properties of the output function generated by the SBF model and found that the output function mimics behavioral responses of animals performing peak interval procedures. We found analytically that, in the absence of any kind of variability in the parameters of the SBF model, the width of the output function only depends on the number of oscillators and the range of frequencies they cover. Therefore, in the absence of parameter variability the scalar property is violated.
We showed that if parameter variability is allowed, then the output function of the SBF model with cosine oscillators is always Gaussian, which is a consequence of the central limit theorem, regardless the pdf of the fluctuating parameter(s). Moreover, we found that the scalar property is also preserved regardless the pdf of the fluctuating parameter(s).
We also conjectured that the following two statements are always true in any noisy SBF implementation: (1) the output function is always Gaussian, which is a consequence of central limit theorem, and (2) the scalar property is valid regardless the pdf of the fluctuating parameter(s). The justification for such general statements is that any periodic waveform of an endogenously spiking neuron can be decomposed into a sum of cosine waves. Based on our theoretical proof that any SBF model with noisy cosine oscillators has a Gaussian output function that obeys the scalar property, we concluded that the biophysical details of the oscillators that generate the train of periodic action potentials are not relevant for the shape of the output function or the validity of the scalar property. Our numerical tests of the SBF model with biophysically realistic periodically spiking ML model neurons showed that the above two conjectures are valid.
Cosine model with no variances violates the scalar property
Close to the criterion time, c, only the fist term in (5) is significant. We used the least square fit method to approximate its envelope with a Gaussian centered on the criterion time. The output function becomes:
where x=π d f(t−c). The envelope of the output function (13) is given by the maxima of s i n(N osc x)/s i n(x), which oscillates much slowly than the c o s((2f1/d f+N osc )x) factor. Therefore, the local maxima of the absolute value of the output function (13) are determined by the zeroes of the first derivative of s i n(N osc x)/s i n(x), i.e., solutions of t a n(N osc x0)=N osc t a n(x0). The corresponding maximum values of the output function (13) are:
The pairs (x0,y0) are determined by the number of oscillators N osc in the network and the range of frequencies covered. However, since there is no dependence of (x0,y0) pair on the criterion time the output function is simply centered on t=c but otherwise totally independent on c. This means that the width σ out of the output function envelope depends only on the range of oscillators’ frequencies f1 and f2=N osc d f and the number of oscillators, but is independent of the criterion time, therefore, violating the scalar property.
Morris-Lecar model equations
where x1 is the membrane potential, x2 is the slow potassium activation and all ionic currents are described by I x =g x (x1−E x ), where g x is the conductance of the voltage gated channel x and E x is the corresponding reversal potential. In particular, the calcium current is I Ca =g Ca m ∞ (x1)(x1−E Ca ), the potassium current is I K =g K x2(x1−E K ), and the leak current is I L =g L (x1−V L ). The reversal potentials for calcium, potassium and leak currents are E Ca =1.0,E K =−0.7,E L =−0.5, respectively. The steady state activation function for calcium channels is m ∞ (x1)=1+ tanh((x1−V1)/V2))/2, where V1=−0.01,V2=0.15, the steady state activation function for potassium channels is w ∞ (x1)=(1+ tanh((x1−V3)/V4])/2 where V3=0.1,V4=0.145, the inverse time constant of potassium channels is λ0(x1)= cosh((x1−V3)/V4/2), the potassium and leak conductances are g K =2.0,g L =0.5, respectively, and the ξ=1.0/3.0.
The two control parameters that can switch the ML model from a Type 1 excitable cell  to a Type 2 are the calcium conductance g Ca and the bias current I0. If g Ca =1.0 and 0.083<I0<0.242 the equations (15) describe what was classified by A.L. Hodgkin as Type 1 excitable cells. If g Ca =0.5 and 0.303<I0<0.138 the equations (15) describe a Type 2 excitable cells. In our simulations, we used a Type 2 ML model neuron that has a membrane potential shape very close to a cosine waveform.
Buhusi C, Meck W: What makes us tick? Functional and neural mechanisms of interval timing. Nature Reviews Neuroscience. 2005, 6 (10): 755-765.
Gallistel CR: The organization of learning. 1990, Cambridge, MA: MIT Press
Meck WH, Penney TB, Pouthas V: Cortico-striatal representation of time in animals and humans. Curr Opin Neurobiol. 2008, 18 (2): 145-152. 10.1016/j.conb.2008.08.002.
Gibbon J: Scalar expectancy theory and Weber’s law in animal timing. Psychol Rev. 1977, 84 (3): 279-325.
Gibbon J, Allan L: Time perception - introduction. Ann N Y Acad Sci. 1984, 423: 1-10.1111/j.1749-6632.1984.tb23412.x.
Gibbon J, Church RM: Sources of variance in an information processing theory of timing. Animal Cognition. Edited by: Roitblat HL, Bever TG, Terrace HS. 1984, Hillsdale, NJ: Erlbaum, 465-488.
Boisvert MJ, Sherry DF: Interval timing by an invertebrate, the bumble bee Bombus impatiens. Curr Biol. 2006, 16 (16): 1636-1640. 10.1016/j.cub.2006.06.064.
Talton LE, Higa J: Interval schedule performance in the goldfish Carassius auratus. Behav Process. 1999, 45: 193-206. 10.1016/S0376-6357(99)00018-2.
Cheng K, Westwood R: Analysis of single trials in pigeons’ timing performance. J Exp Psychol: Anim Behav Process. 1993, 19: 56-67.
Dews PB: The effect of multiple S delta periods on responding on a fixed-interval schedule. J Exp Anal Behav. 1962, 5: 369-74. 10.1901/jeab.1962.5-369.
Buhusi CV, Aziz D: Interval timing accuracy and scalar timing in C57BL/6 mice. Behav Neurosci. 2009, 123 (5): 1102-1113.
Rakitin BC, Gibbon J, Penney TB, Malapani C, Hinton SC, Meck WH: Scalar expectancy theory and peak-interval timing in humans. J Exp Psychol: Anim Behav Processes. 1998, 24: 15-33.
Matell MS, King GR, Meck WH: Differential modulation of clock speed by the administration of intermittent versus continuous cocaine. Behav Neurosci. 2004, 118: 150-156.
Clarke S, Ivry R: The effects of various motor system lesions on time perception in the rat. Proceedings of the Annual Meeting of the Society for Neuroscience. 1997, Washington, DC: Society for Neuroscience; 23, 778-778.
Dallal NL, Meck WH: Depletion of Dopamine in the caudate nucleus but not destruction of vestibular inputs impairs short-interval timing in rats. Soc Neurosci Abstr. 1993, 19: 1583.
Matell MS, Chelius CM, Meck WH, Sakata S: Effect of unilateral or bilateral retrograde 6-OHDA lesions of the substantia nigra pars compacta on interval timing. Abstr-Soc Neurosci. 2000, 26: 650.
Matell MS, Meck WH, Nicolelis MA: Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. Behav Neurosci. 2003, 117: 760-773.
Maricq AV, Roberts S, Church RM: Methamphetamine and time estimation. J Exp Psychol: Anim Behav Process. 1981, 7: 18-30.
Maricq AV, Church RM: The differential effects of haloperidol and methamphetamine on time estimation in the rat. Psychopharmacology. 1983, 79: 10-15. 10.1007/BF00433008.
Matell MS, Meck WH: A comparison of the tri-peak and peak- interval procedure in rats: equivalency of the clock speed enhancing effect of methamphetamine on interval timing. Abs-Soc Neurosci. 1997, 23: 1315-1316.
Matell MS, Meck WH: Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Cogn Brain Res. 2004, 21 (2): 139-70. 10.1016/j.cogbrainres.2004.06.012.
Meck WH: Selective adjustment of the speed of internal clock and memory processes. J Exp Psychol: Anim Behav Process. 1983, 9 (2): 171-201.
Meck WH: Neuropharmacology of timing and time perception. Cogn Brain Res. 1996, 3 (3–4): 227-242.
Neil DB, Herndon Jr JG: Anatomical specificity within rat striatum for the dopaminergic modulation of DRL responding and activity. Brain Res. 1978, 153: 529-538. 10.1016/0006-8993(78)90337-2.
Meck WH: Hippocampal function is required for feedback control of an internal clock’s criterion. Behav Neurosci. 1988, 1102: 54-60.
Drew M, Fairhurst S, Malapani C, Horvitz J, Balsam P: Effects of dopamine antagonists on the timing of two intervals. Int J Psychophysiol. 2003, 75: 9-15.
Harrington DL, Haaland KY, Hermanowicz N: Temporal processing in the basal ganglia. Neuropsychology. 1998, 12: 3-12.
Harrington DL, Haaland KY: Neural underpinnings of temporal processing: a review of focal lesion, pharmacological, and functional imaging research. Rev Neurosci. 1999, 10: 91-116.
Hinton SC, Meck WH, MacFall JR: Peak-interval timing in humans activates frontal-striatal loops. NeuroImage. 1996, 3: S224-10.1016/S1053-8119(96)80226-6.
Lejeune H, Maquet P, Bonnet M, Casini L, Ferrara A, Macar F, Pouthas V, Timsit-Berthier M, Vidal F: The basic pattern of activation in motor and sensory temporal tasks: positron emission tomography data. Neurosci Lett. 1997, 235 (1–2): 21-24.
Maquet P, Lejeune H, Pouthas V, Bonnet M, Casini L, Macar F, Timsit-Berthier M, Vidal F, Ferrara A, Degueldre C, Quaglia L, Delfiore G, Luxen A, Woods R, Maziotta J, Comar D: Brain activation induced by estimation of duration: a PET study. NeuroImage. 1996, 3: 119-126. 10.1006/nimg.1996.0014.
Rao S, Harrington D, Haaland K, Bobholz J, Cox R, Binder J: Distributed neural systems underlying the timing of movements. J Neurosci. 1997, 17: 5528-5535.
Rao S, Mayer A, Harrington D: The evolution of brain activation during temporal processing. Nat Neurosci. 2001, 4: 317-323. 10.1038/85191.
Coull JT, Vidal F, Nazarian B, Macar F: Functional anatomy of the attentional modulation of time estimation. Science. 2004, 303: 1506-1508. 10.1126/science.1091573.
Binkofski F, Block RA: Accelerated time experience after left frontal cortex lesion. Neurocase. 1996, 2: 485-493. 10.1080/13554799608402424.
Malapani C, Rakitin B, Levy R, Meck W, Deweer B, Dubois B, Gibbon J: Coupled temporal memories in Parkinson’s disease: a dopamine-related dysfunction. J Cognit Neurosci. 1998, 10: 316-331. 10.1162/089892998562762.
Nichelli P, Clark K, Hollnagel C, Grafman J: Duration processing after frontal lobe lesions. Ann N Y Acad Sci. 1995, 769: 183-190. 10.1111/j.1749-6632.1995.tb38139.x.
Meck WH: Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock. Pharmacol Biochem Behav. 1986, 25: 1185-1189. 10.1016/0091-3057(86)90109-7.
Harrington DL, Haaland KY: Sequencing in Parkinson’s disease. Abnormalities in programming and controlling movement. Brain Res. 1991, 114: 99-115.
Malapani C, Deweer B, Gibbon J: Separating storage from retrieval dysfunction of temporal memory in Parkinson’s disease. J Cognit Neurosci. 2002, 14: 311-322. 10.1162/089892902317236920.
Malapani C, Fairhurst S: Scalar timing in animals and humans. Learn Motiv. 2002, 33: 156-176. 10.1006/lmot.2001.1105.
Meck WH, Church RM: Cholinergic modulation of the content of temporal memory. Behav Neurosci. 1987, 101: 457-464.
Meck WH, Church RM: Nutrients that modify the speed of internal clock and memory storage processes. Behav Neurosci. 1987, 101: 465-475.
Olton DS, Wenk GL, Church RM, Meck WH: Attention and the frontal cortex as examined by simultaneous temporal processing. Neuropsychologia. 1988, 26: 307-318. 10.1016/0028-3932(88)90083-8.
Church RM, Broadbent HA: Alternative representations of time, number, and rate. Cognition. 1990, 37 (1–2): 55-81.
Church RM, Broadbent HA: A connectionist model of timing. Quantitative models of behavior: Neural networks and conditioning. Edited by: Commons ML, Grossberg S, Staddon JER. 1991, Hillsdale, NJ: Erlbaum, 225-240.
Church R, Lacourse D, Crystal J: Temporal search as a function of the variability of interfood intervals. J Exp Psychol: Anim Behav Process. 1998, 24: 291-315.
Crystal J: Systematic nonlinearities in the perception of temporal intervals. J Exp Psychol: Anim Behav Processes. 1999, 25: 3-17.
Crystal J, Church R, Broadbent H: Systematic nonlinearities in the memory representation of time. J Exp Psychol: Anim Behav Processes. 1997, 23: 267-282.
Wearden J, Doherty M: Exploring and developing a connec- tionist model of animal timing: peak procedure and fixed-interval simulations. J Exp Psychol: Anim Behav Processes. 1995, 23: 99-115.
Aschoff J: Temporal orientation: circadian clocks in animals and humans. Anim Behav. 1989, 37: 881-896.
Miall RC: The storage of time intervals using oscillating neurons. Neural Comput. 1989, 1: 359-371. 10.1162/neco.1918.104.22.1689.
Church R, Meck W, Gibbon J: Application of scalar timing theory to individual trials. J Exp Psychol: Anim Behav Processes. 1994, 20: 135-155.
Schneider BA: A two-state analysis of fixed- interval responding in pigeons. J Exp Anal Behav. 1969, 12: 667-687.
Fellous J, Tiesinga P, Thomas P, Sejnowski T: Discovering spike patterns in neuronal responses. J Neurosci. 2004, 24 (12): 2989-3001. 10.1523/JNEUROSCI.4649-03.2004.
White J, Rubinstein J, Kay A: Channel noise in neurons. Trends Neurosci. 2000, 23: 99-115.
Faisal A, Selen L, Wolpert D: Noise in the nervous system. Nat Rev Neurosci. 2008, 9: 292-303. 10.1038/nrn2258.
Destexhe A, Rudolph M, Pare D: The high-conductance state of neocortical neurons in vivo. Nat Rev Neurosci. 2003, 4: 739-751. 10.1038/nrn1198.
Matsumura M, Cope T, Fetz EE: Sustained excitatory synaptic input to motor cortex neurons in awake animals revealed by intracellular recording of membrane potentials. Exp Brain Res. 1988, 70: 463-469.
Steriade M, Timofeev I, Grenier F: Natural waking and sleep states: a view from inside neocortical neurons. J Neurophysiol. 2001, 85: 1969-1985.
Clay JR, DeFelice LJ: Relationship between membrane excitability and single channel open-close kinetics. Biophys J. 1983, 42: 151-157. 10.1016/S0006-3495(83)84381-1.
Rubinstein JT: Threshold fluctuations in an N sodium channel model of the noise of Ranvier. Biophys J. 1995, 68: 779-785. 10.1016/S0006-3495(95)80252-3.
Chow CC, White JA: Spontaneous action potentials due to channel fluctuations. Biophys J. 1996, 71: 3013-3021. 10.1016/S0006-3495(96)79494-8.
Englitz B, Stiefel K, Sejnowski T: Irregular firing of isolated cortical interneurons in vitro driven by intrinsic stochastic mechanisms. Neural Comput. 2008, 20: 44-64. 10.1162/neco.2008.20.1.44.
Markram H, Toledo-Rodriguez M, Wang Y, Gupta A, Silberberg G, Wu C: Interneurons of the neocortical inhibitory system. Nat Rev Neurosci. 2004, 5 (10): 793-807. 10.1038/nrn1519.
Calvin W, Stevens C: Synaptic noise and other sources of randomness in motoneuron interspike intervals. J Neurophys. 1968, 31: 574-587.
Stevens CF, Zado AM: Input synchrony and the irregular firing of cortical neurons. Nat Neurosci. 1998, 1 (3): 210-217. 10.1038/659.
Morris C, Lecar H: Voltage oscillations in the barnacle giant muscle fiber. Biophys J. 1981, 35: 193-213. 10.1016/S0006-3495(81)84782-0.
Rinzel J, Ermentrout B: Analysis of neural excitability and oscillations. 1998, Cambridge, MA: MIT Press
Hodgkin AL: The local electric changes associated with repetitive action in a non-medullated axon. J Phys. 1948, 107: 165-181.
FitzHugh R: Mathematical models of threshold phenomena in the nerve membrane. Bull Math Biophys. 1955, 17: 257-278. 10.1007/BF02477753.
Nagumo J, Arimoto S, Yoshizawa S: An active pulse transmission line simulating nerve axon. Proc IRE. 1962, 50: 2061-2070.
White J, Budde T, Kay A: A bifurcation analysis of neuronal subthreshold oscillations. Biophys J. 1995, 64 (4): 1203-1217.
Tateno T, Pakdaman K: Random dynamics of the Morris-Lecar neural model. Chaos. 2004, 14 (3): 511-530. 10.1063/1.1756118.
Beiser D, Houk J: Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. Clin Neurophys. 1998, 79: 3168-3188.
Houk JC: Information processing in modular circuits linking basal ganglia and cerebral cortex. Models of, Information Processing in the Basal Ganglia. Edited by: Houk JC, Davis JL, Beiser DG. 1995, Cambridge, MA: MIT Press, 3-10.
Houk JC, Barto AG, Adams JL: A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models of, Information Processing in the Basal Ganglia. Edited by: Houk JC, Davis JL, Beiser DG. 1995, Cambridge, MA: MIT Press, 24-270.
Umemiya M, Raymond L: Dopaminergic modulation of excitatory postsynaptic currents in rat neostriatal neurons. J Neurophys. 1997, 78: 1248-1255.
Pignatelli M, Beyeler A, Leinekugel X: Neural circuits underlying the generation of theta oscillations. J Phys-Paris. 2012, 106 (34): 81-92.
Rizzuto D, Madsen J, Bromfield E, Schulze-Bonhage A, Seelig D, Aschenbrenner-Scheibe R, Kahana M: Reset of human neocortical oscillations during a working memory task. Proc Nat Acad Sci USA. 2003, 100: 7931-7936. 10.1073/pnas.0732061100.
Steriade M, Jones EG, Llinas RR: Thalamic oscillations and signaling. 1990, Oxford, England: John Wiley and Sons
Oprisan S, Buhusi C: Modelling pharmacological clock and memory patterns of interval timing in a striatal beat-frequency model with realistic, noisy neurons. Front Integr Neurosci. 2011, 5: 52.
Oprisan SA, Buhusi CV: How noise contributes to time-scale invariance of interval timing. Phys Rev E. 2013, 87 (5): 052717.
Oprisan SA, Dix S, Buhusi CV: Phase resetting and its implications for interval timing with intruders. Behav Process. 2013, 1-10. in press.
Buhusi CV, Oprisan SA: Time-scale invariance as an emergent property in a perceptron with realistic, noisy neurons. Behav Process. 2013, 95: 60-70. in press.
Winfree A: The Geometry of Biological Time. 2001, New York: Springer-Verlag
Izhikevich EM: Phase equations for relaxation oscillators. SIAM J Appl Math. 2000, 60: 1789-1805. 10.1137/S0036139999351001.
Guckenheimer J, Holmes P: Nonlinear Oscillations, Dynamical systems and Bifurcations of Vector Fields. 1983, New York: Springer
Kuramoto Y: Chemical Oscillations, Waves, and Turbulence. 1984, New York: Springer-Verlag
Kuznetsov YA: Elements of Applied Bifurcation Theory, 3 edition. 2004, New York: Springer
Ermentrout G: Losing amplitude and saving phase, Volume 66. 1986, Berlin - New York: Springer
Papoulis A, Pillai SU: Probability, Random Variables and Stochastic Processes, 4 edition. 2002, USA: McGraw Hill
Spiegel MR: Theory and Problems of Probability and Statistics. 1992, New York: McGraw-Hill
Reyes A, Fetz E: How modes of interspike interval shortening by brief transient depolarizations in cat neocortical neurons. J Neurophys. 1993, 69: 1661-1672.
Tateno T, Harsch A, Robinson H: Threshold firing frequency-current relationships of neurons in rat somatosensory cortex: type 1 and type 2 dynamics. J Neurophys. 2004, 92: 2283-2299. 10.1152/jn.00109.2004.
Stein EM, Shakarchi R: Fourier Analysis: An Introduction. 2003, Princeton and Oxford: Princeton University Press
Braun H, Wissing H, Schafer K, Hirsch M: Oscillation and noise determine signal transduction in shark multimodal sensory cells. Nature. 1994, 367: 270-273. 10.1038/367270a0.
Douglass J, Wilkens L, Pantazelou E, Moss F: Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance. Nature. 1993, 365: 337-340. 10.1038/365337a0.
Galan R, Fourcaud-Trocme N, Ermentrout GB, Urban NN: Correlation-induced synchronization of oscillations in olfactory bulb neurons. J Neurosci. 2006, 26: 3646-3655. 10.1523/JNEUROSCI.4605-05.2006.
Tateno T, Robinson H: Quantifying noise-induced stability of a cortical fast-spiking cell model with Kv3-channel-like current. Biosystems. 2007, 86 (1–3): 110-116.
Ditlevsen S, Greenwood P: The Morris-Lecar neuron model embeds a leaky integrate-and-fire model. J Math Bio. 2013, 67 (2): 239-159. 10.1007/s00285-012-0552-7.
Killeen PR, Fetterman JG: A behavioral theory of timing. Psychol Rev. 1988, 95 (2): 274-95.
Grossberg S, Schmajuk N: Neural dynamics of adaptive timing and temporal discrimination during associative learning. Neural Netw. 1989, 2: 79-102. 10.1016/0893-6080(89)90026-9.
Grossberg S, Merrill JW: A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Brain Res Cogn Brain Res. 1992, 1 (1): 3-38. 10.1016/0926-6410(92)90003-A.
Machado A: Learning the temporal dynamics of behavior. Psychol Rev. 1997, 104 (2): 241-65.
Staddon JER, Higa JJ: Time and memory: towards a pacemaker-free theory of interval timing. J Exp Anal Behav. 1999, 71 (2): 215-251. 10.1901/jeab.1999.71-215.
Staddon JER, Higa JJ, Chelaru IM: Time, trace, memory. J Exp Anal Behav. 1999, 71 (2): 293-301. 10.1901/jeab.1999.71-293.
Leon MI, Shadlen MN: Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron. 2003, 38 (2): 317-327. 10.1016/S0896-6273(03)00185-5.
Simen P, Balci F, deSouza L, Cohen JD, Holmes P: A model of interval timing by neural integration. J Neurosci. 2011, 31 (25): 9238-9253. 10.1523/JNEUROSCI.3121-10.2011.
Reutimann J, Yakovlev V, Fusi S, Senn W: Climbing neuronal activity as an event-based cortical representation of time. J Neurosci. 2004, 24: 3295-3303. 10.1523/JNEUROSCI.4098-03.2004.
Gallistel CR, Gibbon J: Time, rate, and conditioning. Psychol Rev. 2000, 107: 289-344.
Karmarkar UR, Buonomano DV: Timing in the absence of clocks: encoding time in neural network states. Neuron. 2007, 53 (3): 427-438. 10.1016/j.neuron.2007.01.006.
Ermentrout GB: Type I membranes, phase resetting curves, and synchrony. Neural Comput. 1996, 8 (5): 979-1001. 10.1162/neco.1922.214.171.1249.
This research was supported by the CAREER award IOS 1054914 from the National Science Foundation to SAO and by the National Institutes of Health grants MH65561 and MH73057 to CVB.
The authors declare no disclosure of financial interests and potential conflict of interest.
The analytical results regarding the Gaussian shape of the output function and the scalar property were obtained by SAO. CVB contributed to the implementation of the SBF model with cosine oscillators. SAO implemented the SBF model with ML model neurons and conducted all numerical simulations. Both authors contributed equally to the draft the manuscript. Both authors read and approved the final manuscript.