The ability to estimate durations in the seconds-to-minutes range - interval timing - is essential for survival, adaptation and its impairment leads to severe cognitive and/or motor dysfunctions. The response rate near a memorized duration has a Gaussian shape centered on the to-be-timed interval (criterion time). The width of the Gaussian-like distribution of responses increases linearly with the criterion time, i.e., interval timing obeys the scalar property.

Results

We presented analytical and numerical results based on the striatal beat frequency (SBF) model showing that parameter variability (noise) mimics behavioral data. A key functional block of the SBF model is the set of oscillators that provide the time base for the entire timing network. The implementation of the oscillators block as simplified phase (cosine) oscillators has the additional advantage that is analytically tractable. We also checked numerically that the scalar property emerges in the presence of memory variability by using biophysically realistic Morris-Lecar oscillators. First, we predicted analytically and tested numerically that in a noise-free SBF model the output function could be approximated by a Gaussian. However, in a noise-free SBF model the width of the Gaussian envelope is independent of the criterion time, which violates the scalar property. We showed analytically and verified numerically that small fluctuations of the memorized criterion time leads to scalar property of interval timing.

Conclusions

Noise is ubiquitous in the form of small fluctuations of intrinsic frequencies of the neural oscillators, the errors in recording/retrieving stored information related to criterion time, fluctuation in neurotransmitters’ concentration, etc. Our model suggests that the biological noise plays an essential functional role in the SBF interval timing.

Background

The capability of perceiving and using the passage of time in the seconds-to-minutes range (interval timing) is essential for survival and adaptation, and its impairment leads to severe cognitive and motor dysfunctions [1–3]. In most species, interval timing is both accurate and time-scale invariant, or simply scalar, in that the error in time estimation is proportional to the estimated duration [4–6]. When timing a 30s interval (Figure 1A), responses follow a quasi-Gaussian distribution around the 30s target duration. Furthermore, when timing a 90s interval (Figure 1C), responses also follow a quasi-Gaussian distribution around the 90s target duration. The scalar property is evident in that normalizing the response functions by the target duration and by the maximum response rate yields superimposition of response functions (Figure 1B). The time-scalar invariance property of interval timing is ubiquitous in many species from invertebrates such as bees [7], to many vertebrates, such as fish [8], birds [9], and mammals such as rats [10], mice [11] and humans [12].

Although the localization of brain regions involved in interval timing is not yet clear, some progress has been made. For example, both temporal production and temporal perception are strongly connected to striatum and its afferent projections from the substantia nigra pars compacta [14–16]. In addition, it was shown that the firing patterns of striatal neurons peak around a trained criterion time, a pattern consistent with substantial striatal involvement in interval timing [17]. Pharmacological data also suggest a strong basal ganglia involvement in interval timing. Administration of dopaminergic drugs both systemically [13, 18–23] or directly into the anterior portion of the striatum [24] alters the speed of interval timing. Experiments showed a shift in the perceived time towards earlier times following systemic dopamine (DA) agonists administration (e.g., methamphetamine or cocaine) whereas systemic DA antagonists administration (e.g., haloperidol) shift the response times in the opposite direction (clock pattern). A possible physiological hypothesis is that DA causes internal clock(s) to run faster than normal, therefore, shifting the entire response of the animal earlier than the control [20, 25, 26].

Studies done in humans also support the hypothesis that striatum and its afferents are involved in interval timing [27–33]. Recent fMRI data showed that timing network could involve cortico-striatal loops, including premotor and supplementary motor areas, frontal operculum and dorsolateral prefrontal cortex, and temporal and parietal cortices, as well as the putamen [34]. Imaging studies in humans [28–30, 32], lesion studies in humans [31, 35–37] and rodents [14, 15, 22], and drug studies in rodents [17–20, 22–24, 38] all point towards a central role of the basal ganglia in interval timing. The anatomy of the basal ganglia suggests that information is proceeded through cortico-striato-thalamic loops. Severe deficiencies in reproducing temporal intervals were also found in Parkinson’s patients, therefore, further supporting the hypothesis of basal ganglia involvement in interval timing [36, 39–41]. There are also lesions data suggesting that the timing network is much widely distributed. Lesions of the nucleus basalis magnocellularis, a cholinergic nucleus in the basal forebrain with projections to the frontal cortex, induced a progressive, proportional, delay in peak time response (memory pattern). This effect is believed to be related to altered temporal memories [42, 43] due to change in acetylcholine (ACh) level. Lesions of the frontal cortex produce similar memory patterns [44], whereas lesions of the hippocampus or fimbria fornix, a basal forebrain cholinergic nucleus with projections to the hippocampus, result in memory effects translated into an advance of the peak time response [42–44]. These experimental findings undoubtedly support the hypothesis of a distributed interval timing neural network.

The connectionist model is among the first attempts to integrate a large collection of experimental findings into a coherent distributed network model of interval timing by Church and Broadbent [45, 46]. They assumed that a set of neural oscillators, probably localized in the prefrontal cortex, determines the peak time using multiple-period discrimination algorithms. In their model, the current phases of oscillators (clock stage) are continually compared against the memorized phases at the reinforcement time (memory stage). The connectionist model successfully duplicated the scalar property and the response form of both peak-interval [46] and fixed-interval procedures [47]. The connectionist model also presents higher accuracy for intervals near the underlying oscillator period similar to experimental observations [48–50]. However, the connectionist model is limited to timing durations that do not exceed the longest period of the set of oscillators and requires a quite large coefficient of variation [51].

Another successful distributed network model, called the beat frequency model, uses beats between multiple oscillators to produce a much wider range of durations than the intrinsic periods of individual oscillators [13, 21, 52]. It is assumed that at the beginning of each trial all oscillators are reset and start in phase. At the reinforcement time, the oscillators are read out to determine whether they are spiking (“on” state) or are silent (“off” state). The small group of neurons that spike at the reinforcement time represents the neural code for that particular duration. A temporal prediction is made by a threshold-driven comparison between the number of strengthened neurons currently firing and the number of neurons that fired at the reinforcement time. Miall [52] conducted numerical simulations using beat frequency model and found a second peak halfway through the criterion duration similar to the “breakpoint” time observed in the peak-interval procedure [53]. In addition, the third highest peak corresponds to 2/3 of the way to the criterion in a manner similar to the breakpoint seen in fixed interval procedures [54].

In this study, we generalized previous results regarding the quasi-Gaussian shape and the scalar property using the SBF model [13, 21, 52]. Although it was long assumed that the behavioral response curve for peak procedure could be approximated by a Gaussian, here we actually proved theoretically and checked numerically that it is always a Gaussian. Furthermore, we showed that this fact is independent of the type of variability, or biological noise, present in the interval timing network.

We also showed that the scalar property is a universal feature of any SBF model regardless the type of model neurons used and the type of probability distribution functions (pfd) for parameters affected by biological noise. Variability in the SBF model could be ascribed to channel gating fluctuations [55, 56], noisy synaptic transmission [57], and background network activity [58–60]. Single-cell recordings support the hypothesis that irregular firing in cortical interneurons is determined by the intrinsic stochastic properties (channel noise) [61–63] of individual neurons [64, 65]. At the same time, fluctuations in the presynaptic currents that drive cortical spiking neurons have a significant contribution to the large variability of the interspike intervals [66, 67]. For example, in spinal neurons, synaptic noise alone fully accounts for output variability [66]. In this paper, we are not concerned with the biophysical mechanisms that generated irregular firing of cortical oscillators. We rather investigate if assumed variability in SBF model’s parameters can produce precise and time-scale invariant interval timing.

Within the SBF paradigm we used a simple model of cortical oscillators, i.e., a cosine wave (phase) model (see [52] and references therein) and showed analytically that it (a) violates the scalar property in the absence of model’s parameters variability (noise), and (b) the output function is always Gaussian and obeys the scalar property regardless the pdf of assumed model’s variability. The above two analytical predictions were numerically confirmed both with the cosine wave model oscillators and with a more biophysically realistic, conductance-based, Morris-Lecar (ML) model neuron [68, 69]. ML model neuron was developed for the giant muscle fiber of barnacles [68] by combining Hodgkin-Huxley [70] and FitzHugh-Nagumo [71, 72] models into a voltage-gated calcium channel model with a delayed-rectifier potassium channel. Since then, ML model was successfully used for describing different types of cortical neurons. For example, White et al[73] performed voltage-clamp recordings from entorhinal cortical neurons of mice and calibrated a ML model neuron in which they replaced the calcium current by an instantaneously-activated persistent sodium current. By comparing the results of ML model neuron against experimental data, they found that “this reduction in the number of dependent variables does not alter significantly the behavior of the system.” For this reason, and because the ML model is considered a canonical prototype for widely encountered classes of both deterministic and stochastic neurons [74], we used ML model in our implementation of the SFB model.

Methods

We introduced a minimal block diagram that mimics the contributions of some of the neuroanatomical regions known to be involved in interval timing as identified in the Introduction. The schematic diagram includes the following blocks (see Figure 2). An oscillator block (OSC), presumably mimicking the neural oscillators localized in the prefrontal cortex area [17]. A memory block (MEM), presumably mimicking the activity associated with the nucleus basalis magnocellularis [42, 43], frontal cortex [44], and/or hippocampus or fimbria fornix [42–44]. Its role is to stores the information about the state of the brain at the reinforcement time. A decision block (OUT), presumably mimicking the striatal spiny neurons that by integrating a very large number of different inputs and responding selectively to particular reinforced patterns [75–77]. Finally, a neuromodulator block (MOD) that mimics the modulation of cortical and thalamic-induced activity of the striatal spiny neurons. The MOD block also modulates the threshold for coherent activity detection due to dopamine release from substantia niagra pars compacta [78].

The oscillator block (OSC)

is composed of N_{
osc
} neural oscillators with frequencies distributed over a range (f_{1},f_{2}) consistent with neurobiological observations [21, 52, 79–81]. The fixed firing frequencies of individual neural oscillators, f_{
i
}, are equally spaced, i.e, f_{
i
}=f_{1}+i·df with frequency increments df=(f_{2}−f_{1})/N_{
osc
}. OSC provides the underlying time base for the interval timing network. In the presence of noise, e.g., ionic channel noise [55, 56, 61–65] or background neural activity from other cortical areas [57–60, 66, 67], a set N_{
f
} of N_{
osc
} frequencies, , are generated from a random distribution around f_{
i
} with a frequency variability x_{
f
} that obeys a given probability density function pdf_{
f
}. The output function is an average over all N_{
f
} distributions of frequencies.

The memory block (MEM)

stores a criterion time value, c, memorized during the training process. Both storing and retrieving the criterion time to and from the long-term memory are affected by biological context (brain state, noise, etc.) Therefore, in the presence of noise, a set N_{
c
} of randomly distributing values are generated with the mean c and variability x_{
c
} according to a given probability density function pdf_{
c
}. The output function averages over all N_{
c
} randomly distributed values of the criterion time c.

The decision/output block (OUT)

relates the internal perception of time with external actions.

In order to implement the decision-making process ascribed to basal ganglia, we define a set of numbers (weights) that represent the state of each oscillator. The weight w(k,c) encodes the state of k^{
t
h
} neural oscillator from the OSC block at the reinforcement (criterion) time. Although it is not the only possibility, the “state” of the brain at the reinforcement time could be given, for example, by the phases or the amplitudes of all neural oscillators in OSC. The OUT block estimates the “closeness” between the current state of the brain represented by the running weights w(k,t) and the memorized weights at the reinforcement time w(k,c). Among many possible implementations of the “closeness”, we chose the projection of the running weights w(k,t) along the vector of reference weights w(k,c) (the dot product of vectors w(k,c) and w(k,t)).

The neuromodulator block (MOD)

mimics the experimentally observed effects of neuromodulators on interval timing. The actual mechanism implemented in this SBF model directly changes the firing frequency of all neurons in the OSC block proportional to the level of neuromodulator. In this implementation of the SBF model, we used the MOD block as a “start gun” that resets the OSC block at the beginning of each trial such that all neural oscillators state in phase. Elsewhere [82–85], we showed that a more detailed implementation of the DA modulation in the SBF model correctly reproduces the clock patterns: immediate change in timing and gradual re-calibration under the drug, immediate re-bound in the opposite direction and gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects as observed in experiments (see, for example, [23]). Similarly, we showed [82–85] that manipulations of ACh level that modulates the long-term memory lead to memory patterns: gradual change in timing on-drug, gradual re-calibration upon discontinuing the drug, and scalar (proportional) effects (see [23] for comparison with experiments).

The SBF model with cosine oscillators

In order to gain insight into the functionality of the SBF block model, we initially assumed that the time base is provided by cosine (phase) oscillators. A phase oscillator is a mathematical abstraction obtained by reducing a complex and detailed mathematical model of a biological neuron to a single parameter - the firing phase measured with respect to an arbitrary reference [86–90]. The simplest possible oscillatory behavior is represented by cos(2πft), where the argument of cosine is called the phase of oscillation, t is the temporal variable, and f is the fixed firing frequency of the oscillator. Phase oscillators represent a significant class of neural oscillators and all complex neural oscillators can be reduced to a phase oscillator near bifurcation points [91].

In our implementation of the SBF model, the reference weights w(k,c), which represent the state of the brain at the reinforcement (criterion) time are normalized values of the state of neuron k:

(1)

where the sum is considered over all stored criteria that fluctuate around c due to memory noise. The normalization factor is the maximum value over all states , in which case the reference weight is bounded −1<w(k,c)<1. We also tested positively defined weights given by:

(2)

and found no significant difference in the properties of the output function.

In this implementation of the SBF model, OUT works as a phase detector, i.e., if the current vector of weights w(k,t) at the current phases (time) matches the reference weights vector w(k,c) at criterion time, c, then a strong response is delivered, otherwise the response is negligible. In order to generate a response, the OUT block computes the current weights w(k,t) for each oscillator according to (1), or (2), and projects them along the reference weights vector w(k,c):

(3)

Based on (3), we computed the absolute value of the cosine of the angle between w(k,t) and w(k,c), which smoothly varies between unity, when the current state of the brain coincides with the one memorized at the reinforcement time, and zero, when there is no overlap between them. Other common and equally appealing choices in computational neuroscience, but a bit more expensive from a computational point of view, are sigmoidal functions or double exponentials, both of which are often used to mimic experimentally measured activation/inactivation curves with smooth transitions between “off” (zero) and “on” (unity) states.

Results

Cosine oscillators with no variability

We gained significant insight into the dynamics of SBF model by assuming no noise (variability) in any of the model’s parameters. According to (1), the state of the OSC bock at the reinforcement time, i.e., the reference weights w(k,c), is the set of the normalized amplitudes of the k^{
t
h
} phase (cosine) oscillator. According to (3), the output function of the SBF model with noiseless cosine oscillators is:

(4)

which becomes:

(5)

The output function (5) has two symmetric and strong peaks at t=±c, of which we only retain the first one that has a sharp output when t→c. We found that 1/2sin(πN_{
osc
}df(t−c))cos(π(2f_{1}+N_{
osc
}df)(t−c))/sin(πdf(t−c)) approaches 1/2N_{
osc
} as t→c, which is in agreement with numerical simulations carried out for a network of 1000 noiseless phase oscillators (see Figure 3). Figure 3A shows the numerically generated output function of the SBF model with noiseless phase oscillators for three memorized criteria, i.e., 30s, 60s, and 90s. Our numerical simulations show that the response of the SBF model peaks when the pattern of input activity w(k,t) “lines-up” or “coincides” with the one stored at the reinforcement time, c, i.e., this SBF model is able to produce precise interval timing. The shape of the output function at each criterion time (see Figure 3A) is captured by the sinc function envelope(t)=sin(πN_{
osc
}df(t−c))/sin(πdf(t−c)), which peaks at t=c (see Eq. (5)). The width of the sinc envelope above is the solution of the equation envelope(c−width/2)=1/2envelope(c), i.e, sin(πN_{
osc
}dfwidth/2)/sin(πdfwidth/2)=1/2N_{
osc
}, which shows that the width of the envelope is independent of the criterion time, i.e., it violates time-scale invariance property of interval timing. We conducted numerical simulations with various to-be-timed criteria (see Figure 3B) and found that the width of the output is indeed constant rather than increasing proportionally to the criterion time as required by time-scale invariance property of interval timing. In conclusion, a noiseless SBF model is accurate (peaks at criterion time as seen in Figure 3A), but does not exhibit time-scale invariance (the width of the output does not scale-up with the criterion time as seen in Figure 3B).

Cosine oscillators with arbitrary memory variability

As mentioned in the Introduction, biological noise is ubiquitous both as channel noise affecting the dynamics of individual oscillators [55, 56, 61–65] and as stochastic synaptic inputs or network background activity [57–60, 66, 67]. In this implementation of the SBF model, we investigated the effect of criterion time (memory) variability due to noisy storage and retrieval of the criterion time on scalar timing. We found that regardless the pdfs of the stochastic variables involved, the output function is (a) always Gaussian and (b) obeys time-scale invariance property. To prove analytically our conjectures, let us assume only criterion time variability and rewrite the output function (4) as follows:

(6)

We only considered the physically realizable first term centered at t=+c, which lead to:

(7)

where a_{
j
}=π(t−c_{
j
}). In the presence of memory variability, the criterion time is a stochastic variable c_{
j
}=c(1+x_{
j
}) where x has a pdfp_{
X
}(x). Using pdf transformation rules [92, 93], we found the pdf of the new stochastic variable in (7):

(8)

The pdf_{
z
} of the new stochastic variable z(x) is related to the pdf_{
x
} of the criterion time p_{
X
}(x) through well-known relationship [92, 93]: p_{
Z
}(z)=p_{
X
}(h−1(z))|dx/dz|. Based on the central limit theorem, the output function (7), which is a sum over N_{
c
} stochastic variables with the pdf_{
Z
}(z), is always a Gaussian regardless the pdf of the criterion time.

What about the time-scale invariance property? Is this feature of the output function still preserved regardless the pdf of the criterion time? Based on (8), we estimated the time-dependent output function by averaging over the criterion time fluctuations:

(9)

where the range (x_{
min
},x_{
max
}) depends on the type of pdf_{
X
}(x). Based on the first mean theorem for integrals, there exists a value x_{
min
}<θ<x_{
max
} such that (9) becomes:

(10)

To compute the width of the output function we introduced the dimensionless variable y=(t−c)/cθ. The width is the value y_{0}=(t_{0}−c)/cθ at which the amplitude of the output function (10) is half its maximum value:

(11)

Using t_{0}=c+σ/2, where σ is the half-width of the output function (10), the equation (11) becomes:

(12)

and y_{0}=σ/(2cθ) with θ≠0. If a solution y_{0} exists for Eq. (12), then the width σ of the output function must obey the scalar property because σ=2cθy_{0} increases linearly with the criterion time c.

We carried out numerical simulations using cosine model with N_{
c
} different criterion times distributed around c. Figure 3C shows the output of the SBF model when N_{
c
} criteria are drawn from a uniform distribution centered on c. For the particular realization of the criteria with uniform distribution, it results form Figure 3C that the width of the Gaussian envelope (dashed line) increases with c. Figure 3D shows that the width of the Gaussian fit scales linearly with the criterion time both for uniformly distributed criteria (solid rhombs in Figure 3D) and normal distribution (solid square in Figure 3D). These results support our theoretical prediction that the scalar property is valid regardless the pdf of memory variability.

The SBF with biophysically realistic model oscillators

Cosine oscillators were extensively used in numerical simulations of interval timing models with great success [13, 21, 52]. Our current theoretical predictions and numerical simulations of SBF model with cosine oscillators are in good agreement with interval timing experiments. Cosine model has a series of advantages: (1) it is mathematically convenient and computationally efficient, (2) it is close to actual voltage traces recorded from neural oscillators that fire close to a critical (bifurcation) point, and (3) it helps us understand the effects of different types of variabilities (noises) on the output of the SBF interval timing model. However, the cosine waveforms are not physiologically realistic. Furthermore, abstract cosine waveforms, cos(2πft), cannot be linked with the biophysics involved in action potential firing, such as the density of ionic channels, membrane capacitance, etc. Another consequence of these shortcomings is that the cosine waveform cannot account for the effect of neuromodulators since there is no biophysical mechanism behind the cosine oscillators with fixed frequency. Therefore, as highlighted in the Introduction, we replaced the cosine oscillator with a ML model neuron [68, 69] for two main reasons (see Appendix for model equations): 1) ML model neuron is one of the simplest and often used as a realistic cortical oscillator model [74, 94] that includes conductance-based mechanisms similar to Hodgkin-Huxley model [70] involving potassium and calcium channels and, 2) by changing a relatively small subset of model’s parameters, ML model neuron can act as a Type 1 excitable cell (fast spiking) [73] or a Type 2 excitable cell (slowly sinusoidal envelope close to a cosine waveform) [95].

ML oscillators with no variability

In the absence of any variability, our numerical results show that the width of the output function of the SBF model with ML oscillators does not change with criterion time, therefore, violating the scaling property. This finding is not surprising and it was predicted analytically in the case of cosine models. Since any periodic waveform, such as the action potential of an endogenously spiking neuron, can be decomposed in discrete cosine components, we conjectured that “no variability = no scalar property” based on the theoretical results obtained with cosine oscillators. We also noticed that the width of the output function decreases with the increase in the number of neural oscillators. Based on our cosine oscillator results, this observation is also predicable since the output function is the discrete Fourier transform of the reference weights vector w(k,c). Since the temporal and frequency domains are conjugated through a Fourier transform [96], the product ΔfΔt is constant. Therefore, increasing the frequency resolution Δf (by increasing the number of neural oscillators recruited for interval timing tasks over the same frequency range) decreases the temporal spread of the output function and makes the behavioral response more localized.

ML oscillators with arbitrary memory variability

The fact that noise, whether as channel noise [61–63] or background synaptic activity [59, 60] is a crucial ingredient that often leads to new and unexpected effects is not limited to interval timing. For example, the noise facilitates signal transduction [97] and enhances signal detection by sensory systems [98]. The noise also induces synchronization of neural oscillations in olfactory bulb mitral cells [99] or in large networks cortical fast-spiking cells [100]. Cortical neurons have a large coefficient of variation of the interspike interval [64, 65] which can be modeled at different levels of details from an explicit ML stochastic models of ionic channels to phenomenological potential-dependent averages [101]. In this paper, we opted for a phenomenological approach to modeling variability in the interspike interval through a fluctuating bias current.

In order to maintain the parallel with the cosine (phase) model, we report here only the effect of memory variability on the standard deviation of the Gaussian fit of the output function generated by the SBF model with ML oscillators (see Figure 4). First, we noticed from our numerical simulations that the SBF model with ML neurons is less sensitive to the level of memory noise. For example, a noise level of 0.1% that led to a linear dependence of the standard deviation on the criterion time in the case of the SBF model with cosine oscillators produced no significant change in the width of the output function with ML neurons (Figure 4D). The scalar property is indeed valid (Figure 4D), but it emerges at higher levels of memory variability, which were not even accessible to phase model. The slope of the standard deviation was insignificant 0.001±0.001(R^{2}=0.342) for 0.1% memory variance (Figure 4A), 0.007±0.002(R^{2}=0.789) for 1% variance (Figure 4B), respectively, 0.07±0.01(R^{2}=0.898) for 10% memory variance (Figure 4C). We found that a ten fold increase in memory variability (from 1% to 10%) led to a ten fold increase (from 0.007 to 0.07) in the slope of the standard deviation versus criterion time. This result suggests that for the SBF model with ML oscillators σ_{
output
}∝σ_{
c
}c as we predicted and already checked for the SBF model with phase oscillators.

Discussion

Interval timing models vary largely with respect to the fundamental assumptions and the hypothesized mechanisms by which temporal processing is explained. In addition, interval timing model attempt explaining time-scale invariance, or drug effects differently. Among the most prominent models of interval timing we cite pacemaker/accumulator processes [4–6], sequences of behaviors [102], pure sine oscillators [13, 16, 21, 45], memory traces [103–107], or cell and network-level models [108, 109]. Both neurometric functions from single neurons and ensemble of neurons successfully paralleled the psychometric functions for the to-be-timed intervals shorter than one second [108]. Interacting populations that balance LTP and LTD mechanisms are thought to modulate the firing rate of single-cell with the end effect at the population level that the adaptation leads to a linear decay of the firing rate over time [110]. Therefore, the linear relationship between time and the number of clock ticks of the pacemaker-accumulator model in the SET of interval timing [4] was translated into a linearly decaying firing rate model that maps time and variable firing rate.

By and large, to address time-scale invariance current behavioral theories assume convenient computations, rules, or coding schemes. Scalar timing is explained as either deriving from computation of ratios of durations [4]-[6, 111], adaptation of the speed at which perceived time flows [102], or from processes and distributions that conveniently scale-up in time [45, 103, 105, 106]. Some neurobiological models share computational assumptions with behavioral models and continue to address time-scale invariance by specific computations or embedded linear relationships [112]. Some assume that timing involves neural integrators capable of linearly ramping up their firing rate in time [109], while others assume LTP/LTD processes whose balance leads to a linear decay of the firing rate in time [110]. It is unclear whether such models can account for time-scale invariance in a large range of behavioral or neurophysiological manipulations.

For example, Killeen and Taylor (1988) explained time-scale invariance of timing in terms of noisy information transfer during counting. Similarly, here, we explained time-scale invariance of timing in terms of noisy coincidence detection during timing. Our theoretical predictions based on an SBF model show that time-scale invariance emerges as the property of a (very) large and noisy network. Furthermore, our results regarding the effect of noise on interval timing support and extend the speculation [21] by which an SBF model requires at least one source of variance (noise) to address time-scale invariance. Rather than being a signature of higher-order cognitive processes or specific neural computations related to timing, time-scale invariance naturally emerges in a massively-connected brain from the intrinsic noise of neurons and circuits [1, 108]. This provides the simplest explanation for the ubiquity of scale invariance of interval timing in a large range of behavioral, lesion, and pharmacological manipulations.

Conclusions

We investigated both analytically and numerically the properties of the output function generated by the SBF model and found that the output function mimics behavioral responses of animals performing peak interval procedures. We found analytically that, in the absence of any kind of variability in the parameters of the SBF model, the width of the output function only depends on the number of oscillators and the range of frequencies they cover. Therefore, in the absence of parameter variability the scalar property is violated.

We showed that if parameter variability is allowed, then the output function of the SBF model with cosine oscillators is always Gaussian, which is a consequence of the central limit theorem, regardless the pdf of the fluctuating parameter(s). Moreover, we found that the scalar property is also preserved regardless the pdf of the fluctuating parameter(s).

We also conjectured that the following two statements are always true in any noisy SBF implementation: (1) the output function is always Gaussian, which is a consequence of central limit theorem, and (2) the scalar property is valid regardless the pdf of the fluctuating parameter(s). The justification for such general statements is that any periodic waveform of an endogenously spiking neuron can be decomposed into a sum of cosine waves. Based on our theoretical proof that any SBF model with noisy cosine oscillators has a Gaussian output function that obeys the scalar property, we concluded that the biophysical details of the oscillators that generate the train of periodic action potentials are not relevant for the shape of the output function or the validity of the scalar property. Our numerical tests of the SBF model with biophysically realistic periodically spiking ML model neurons showed that the above two conjectures are valid.

Appendix

Cosine model with no variances violates the scalar property

Close to the criterion time, c, only the fist term in (5) is significant. We used the least square fit method to approximate its envelope with a Gaussian centered on the criterion time. The output function becomes:

(13)

where x=πdf(t−c). The envelope of the output function (13) is given by the maxima of sin(N_{
osc
}x)/sin(x), which oscillates much slowly than the cos((2f_{1}/df+N_{
osc
})x) factor. Therefore, the local maxima of the absolute value of the output function (13) are determined by the zeroes of the first derivative of sin(N_{
osc
}x)/sin(x), i.e., solutions of tan(N_{
osc
}x_{0})=N_{
osc
}tan(x_{0}). The corresponding maximum values of the output function (13) are:

(14)

The pairs (x_{0},y_{0}) are determined by the number of oscillators N_{
osc
} in the network and the range of frequencies covered. However, since there is no dependence of (x_{0},y_{0}) pair on the criterion time the output function is simply centered on t=c but otherwise totally independent on c. This means that the width σ_{
out
} of the output function envelope depends only on the range of oscillators’ frequencies f_{1} and f_{2}=N_{
osc
}df and the number of oscillators, but is independent of the criterion time, therefore, violating the scalar property.

Morris-Lecar model equations

We used a dimensionless, conductance-based, Morris-Lecar model [68, 113] described by the following equations:

(15)

where x_{1} is the membrane potential, x_{2} is the slow potassium activation and all ionic currents are described by I_{
x
}=g_{
x
}(x_{1}−E_{
x
}), where g_{
x
} is the conductance of the voltage gated channel x and E_{
x
} is the corresponding reversal potential. In particular, the calcium current is I_{
Ca
}=g_{
Ca
}m_{
∞
}(x_{1})(x_{1}−E_{
Ca
}), the potassium current is I_{
K
}=g_{
K
}x_{2}(x_{1}−E_{
K
}), and the leak current is I_{
L
}=g_{
L
}(x_{1}−V_{
L
}). The reversal potentials for calcium, potassium and leak currents are E_{
Ca
}=1.0,E_{
K
}=−0.7,E_{
L
}=−0.5, respectively. The steady state activation function for calcium channels is m_{
∞
}(x_{1})=1+ tanh((x_{1}−V_{1})/V_{2}))/2, where V_{1}=−0.01,V_{2}=0.15, the steady state activation function for potassium channels is w_{
∞
}(x_{1})=(1+ tanh((x_{1}−V_{3})/V_{4}])/2 where V_{3}=0.1,V_{4}=0.145, the inverse time constant of potassium channels is λ_{0}(x_{1})= cosh((x_{1}−V_{3})/V_{4}/2), the potassium and leak conductances are g_{
K
}=2.0,g_{
L
}=0.5, respectively, and the ξ=1.0/3.0.

The two control parameters that can switch the ML model from a Type 1 excitable cell [70] to a Type 2 are the calcium conductance g_{
Ca
} and the bias current I_{0}. If g_{
Ca
}=1.0 and 0.083<I_{0}<0.242 the equations (15) describe what was classified by A.L. Hodgkin as Type 1 excitable cells. If g_{
Ca
}=0.5 and 0.303<I_{0}<0.138 the equations (15) describe a Type 2 excitable cells. In our simulations, we used a Type 2 ML model neuron that has a membrane potential shape very close to a cosine waveform.

Declarations

Acknowledgements

This research was supported by the CAREER award IOS 1054914 from the National Science Foundation to SAO and by the National Institutes of Health grants MH65561 and MH73057 to CVB.

Authors’ Affiliations

(1)

Department of Physics and Astronomy, College of Charleston

(2)

Department of Psychology, Utah State University

References

Buhusi C, Meck W: What makes us tick? Functional and neural mechanisms of interval timing.Nature Reviews Neuroscience 2005,6(10):755–765.PubMedView Article

Gallistel CR: The organization of learning. Cambridge, MA: MIT Press; 1990.

Meck WH, Penney TB, Pouthas V: Cortico-striatal representation of time in animals and humans.Curr Opin Neurobiol 2008,18(2):145–152.PubMedView Article

Gibbon J: Scalar expectancy theory and Weber’s law in animal timing.Psychol Rev 1977,84(3):279–325.View Article

Gibbon J, Allan L: Time perception - introduction.Ann N Y Acad Sci 1984, 423:1.View Article

Gibbon J, Church RM: Sources of variance in an information processing theory of timing. In Animal Cognition. Edited by: Roitblat HL, Bever TG, Terrace HS. Hillsdale, NJ: Erlbaum; 1984:465–488.

Boisvert MJ, Sherry DF: Interval timing by an invertebrate, the bumble bee Bombus impatiens.Curr Biol 2006,16(16):1636–1640.PubMedView Article

Talton LE, Higa J: Interval schedule performance in the goldfish Carassius auratus.Behav Process 1999, 45:193–206.View Article

Cheng K, Westwood R: Analysis of single trials in pigeons’ timing performance.J Exp Psychol: Anim Behav Process 1993, 19:56–67.

Dews PB: The effect of multiple S delta periods on responding on a fixed-interval schedule.J Exp Anal Behav 1962, 5:369–74.PubMedView ArticlePubMed Central

Buhusi CV, Aziz D: Interval timing accuracy and scalar timing in C57BL/6 mice.Behav Neurosci 2009,123(5):1102–1113.PubMedView ArticlePubMed Central

Rakitin BC, Gibbon J, Penney TB, Malapani C, Hinton SC, Meck WH: Scalar expectancy theory and peak-interval timing in humans.J Exp Psychol: Anim Behav Processes 1998, 24:15–33.

Matell MS, King GR, Meck WH: Differential modulation of clock speed by the administration of intermittent versus continuous cocaine.Behav Neurosci 2004, 118:150–156.PubMedView Article

Clarke S, Ivry R: The effects of various motor system lesions on time perception in the rat. In Proceedings of the Annual Meeting of the Society for Neuroscience. Washington, DC: Society for Neuroscience; 23; 1997:778–778.

Dallal NL, Meck WH: Depletion of Dopamine in the caudate nucleus but not destruction of vestibular inputs impairs short-interval timing in rats.Soc Neurosci Abstr 1993, 19:1583.

Matell MS, Chelius CM, Meck WH, Sakata S: Effect of unilateral or bilateral retrograde 6-OHDA lesions of the substantia nigra pars compacta on interval timing.Abstr-Soc Neurosci 2000, 26:650.

Matell MS, Meck WH, Nicolelis MA: Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons.Behav Neurosci 2003, 117:760–773.PubMedView Article

Maricq AV, Roberts S, Church RM: Methamphetamine and time estimation.J Exp Psychol: Anim Behav Process 1981, 7:18–30.

Maricq AV, Church RM: The differential effects of haloperidol and methamphetamine on time estimation in the rat.Psychopharmacology 1983, 79:10–15.PubMedView Article

Matell MS, Meck WH: A comparison of the tri-peak and peak- interval procedure in rats: equivalency of the clock speed enhancing effect of methamphetamine on interval timing.Abs-Soc Neurosci 1997, 23:1315–1316.

Matell MS, Meck WH: Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes.Cogn Brain Res 2004,21(2):139–70.View Article

Meck WH: Selective adjustment of the speed of internal clock and memory processes.J Exp Psychol: Anim Behav Process 1983,9(2):171–201.

Meck WH: Neuropharmacology of timing and time perception.Cogn Brain Res 1996,3(3–4):227–242.View Article

Neil DB, Herndon Jr JG: Anatomical specificity within rat striatum for the dopaminergic modulation of DRL responding and activity.Brain Res 1978, 153:529–538.View Article

Meck WH: Hippocampal function is required for feedback control of an internal clock’s criterion.Behav Neurosci 1988, 1102:54–60.View Article

Drew M, Fairhurst S, Malapani C, Horvitz J, Balsam P: Effects of dopamine antagonists on the timing of two intervals.Int J Psychophysiol 2003, 75:9–15.

Harrington DL, Haaland KY, Hermanowicz N: Temporal processing in the basal ganglia.Neuropsychology 1998, 12:3–12.PubMedView Article

Harrington DL, Haaland KY: Neural underpinnings of temporal processing: a review of focal lesion, pharmacological, and functional imaging research.Rev Neurosci 1999, 10:91–116.PubMedView Article

Lejeune H, Maquet P, Bonnet M, Casini L, Ferrara A, Macar F, Pouthas V, Timsit-Berthier M, Vidal F: The basic pattern of activation in motor and sensory temporal tasks: positron emission tomography data.Neurosci Lett 1997,235(1–2):21–24.PubMedView Article

Maquet P, Lejeune H, Pouthas V, Bonnet M, Casini L, Macar F, Timsit-Berthier M, Vidal F, Ferrara A, Degueldre C, Quaglia L, Delfiore G, Luxen A, Woods R, Maziotta J, Comar D: Brain activation induced by estimation of duration: a PET study.NeuroImage 1996, 3:119–126.PubMedView Article

Rao S, Harrington D, Haaland K, Bobholz J, Cox R, Binder J: Distributed neural systems underlying the timing of movements.J Neurosci 1997, 17:5528–5535.PubMed

Rao S, Mayer A, Harrington D: The evolution of brain activation during temporal processing.Nat Neurosci 2001, 4:317–323.PubMedView Article

Coull JT, Vidal F, Nazarian B, Macar F: Functional anatomy of the attentional modulation of time estimation.Science 2004, 303:1506–1508.PubMedView Article

Binkofski F, Block RA: Accelerated time experience after left frontal cortex lesion.Neurocase 1996, 2:485–493.View Article

Malapani C, Rakitin B, Levy R, Meck W, Deweer B, Dubois B, Gibbon J: Coupled temporal memories in Parkinson’s disease: a dopamine-related dysfunction.J Cognit Neurosci 1998, 10:316–331.View Article

Nichelli P, Clark K, Hollnagel C, Grafman J: Duration processing after frontal lobe lesions.Ann N Y Acad Sci 1995, 769:183–190.PubMedView Article

Meck WH: Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock.Pharmacol Biochem Behav 1986, 25:1185–1189.PubMedView Article

Harrington DL, Haaland KY: Sequencing in Parkinson’s disease. Abnormalities in programming and controlling movement.Brain Res 1991, 114:99–115.

Malapani C, Deweer B, Gibbon J: Separating storage from retrieval dysfunction of temporal memory in Parkinson’s disease.J Cognit Neurosci 2002, 14:311–322.View Article

Malapani C, Fairhurst S: Scalar timing in animals and humans.Learn Motiv 2002, 33:156–176.View Article

Meck WH, Church RM: Cholinergic modulation of the content of temporal memory.Behav Neurosci 1987, 101:457–464.PubMedView Article

Meck WH, Church RM: Nutrients that modify the speed of internal clock and memory storage processes.Behav Neurosci 1987, 101:465–475.PubMedView Article

Olton DS, Wenk GL, Church RM, Meck WH: Attention and the frontal cortex as examined by simultaneous temporal processing.Neuropsychologia 1988, 26:307–318.PubMedView Article

Church RM, Broadbent HA: Alternative representations of time, number, and rate.Cognition 1990,37(1–2):55–81.PubMedView Article

Church RM, Broadbent HA: A connectionist model of timing. In Quantitative models of behavior: Neural networks and conditioning. Edited by: Commons ML, Grossberg S, Staddon JER. Hillsdale, NJ: Erlbaum; 1991:225–240.

Church R, Lacourse D, Crystal J: Temporal search as a function of the variability of interfood intervals.J Exp Psychol: Anim Behav Process 1998, 24:291–315.

Crystal J: Systematic nonlinearities in the perception of temporal intervals.J Exp Psychol: Anim Behav Processes 1999, 25:3–17.

Crystal J, Church R, Broadbent H: Systematic nonlinearities in the memory representation of time.J Exp Psychol: Anim Behav Processes 1997, 23:267–282.

Wearden J, Doherty M: Exploring and developing a connec- tionist model of animal timing: peak procedure and fixed-interval simulations.J Exp Psychol: Anim Behav Processes 1995, 23:99–115.

Aschoff J: Temporal orientation: circadian clocks in animals and humans.Anim Behav 1989, 37:881–896.View Article

Miall RC: The storage of time intervals using oscillating neurons.Neural Comput 1989, 1:359–371.View Article

Church R, Meck W, Gibbon J: Application of scalar timing theory to individual trials.J Exp Psychol: Anim Behav Processes 1994, 20:135–155.

Schneider BA: A two-state analysis of fixed- interval responding in pigeons.J Exp Anal Behav 1969, 12:667–687.View Article

Fellous J, Tiesinga P, Thomas P, Sejnowski T: Discovering spike patterns in neuronal responses.J Neurosci 2004,24(12):2989–3001.PubMedView ArticlePubMed Central

White J, Rubinstein J, Kay A: Channel noise in neurons.Trends Neurosci 2000, 23:99–115.View Article

Destexhe A, Rudolph M, Pare D: The high-conductance state of neocortical neurons in vivo.Nat Rev Neurosci 2003, 4:739–751.PubMedView Article

Matsumura M, Cope T, Fetz EE: Sustained excitatory synaptic input to motor cortex neurons in awake animals revealed by intracellular recording of membrane potentials.Exp Brain Res 1988, 70:463–469.PubMedView Article

Steriade M, Timofeev I, Grenier F: Natural waking and sleep states: a view from inside neocortical neurons.J Neurophysiol 2001, 85:1969–1985.PubMed

Clay JR, DeFelice LJ: Relationship between membrane excitability and single channel open-close kinetics.Biophys J 1983, 42:151–157.PubMedView ArticlePubMed Central

Rubinstein JT: Threshold fluctuations in an N sodium channel model of the noise of Ranvier.Biophys J 1995, 68:779–785.PubMedView ArticlePubMed Central

Chow CC, White JA: Spontaneous action potentials due to channel fluctuations.Biophys J 1996, 71:3013–3021.PubMedView ArticlePubMed Central

Englitz B, Stiefel K, Sejnowski T: Irregular firing of isolated cortical interneurons in vitro driven by intrinsic stochastic mechanisms.Neural Comput 2008, 20:44–64.PubMedView ArticlePubMed Central

Markram H, Toledo-Rodriguez M, Wang Y, Gupta A, Silberberg G, Wu C: Interneurons of the neocortical inhibitory system.Nat Rev Neurosci 2004,5(10):793–807.PubMedView Article

Calvin W, Stevens C: Synaptic noise and other sources of randomness in motoneuron interspike intervals.J Neurophys 1968, 31:574–587.

Stevens CF, Zado AM: Input synchrony and the irregular firing of cortical neurons.Nat Neurosci 1998,1(3):210–217.PubMedView Article

Morris C, Lecar H: Voltage oscillations in the barnacle giant muscle fiber.Biophys J 1981, 35:193–213.PubMedView ArticlePubMed Central

Rinzel J, Ermentrout B: Analysis of neural excitability and oscillations. Cambridge, MA: MIT Press; 1998.

Hodgkin AL: The local electric changes associated with repetitive action in a non-medullated axon.J Phys 1948, 107:165–181.

FitzHugh R: Mathematical models of threshold phenomena in the nerve membrane.Bull Math Biophys 1955, 17:257–278.View Article

Nagumo J, Arimoto S, Yoshizawa S: An active pulse transmission line simulating nerve axon.Proc IRE 1962, 50:2061–2070.View Article

White J, Budde T, Kay A: A bifurcation analysis of neuronal subthreshold oscillations.Biophys J 1995,64(4):1203–1217.View Article

Tateno T, Pakdaman K: Random dynamics of the Morris-Lecar neural model.Chaos 2004,14(3):511–530.PubMedView Article

Beiser D, Houk J: Model of cortical-basal ganglionic processing: encoding the serial order of sensory events.Clin Neurophys 1998, 79:3168–3188.

Houk JC: Information processing in modular circuits linking basal ganglia and cerebral cortex. In Models of, Information Processing in the Basal Ganglia. Edited by: Houk JC, Davis JL, Beiser DG. Cambridge, MA: MIT Press; 1995:3–10.

Houk JC, Barto AG, Adams JL: A model of how the basal ganglia generate and use neural signals that predict reinforcement. In Models of, Information Processing in the Basal Ganglia. Edited by: Houk JC, Davis JL, Beiser DG. Cambridge, MA: MIT Press; 1995:24–270.

Umemiya M, Raymond L: Dopaminergic modulation of excitatory postsynaptic currents in rat neostriatal neurons.J Neurophys 1997, 78:1248–1255.

Pignatelli M, Beyeler A, Leinekugel X: Neural circuits underlying the generation of theta oscillations.J Phys-Paris 2012,106(34):81–92.View Article

Rizzuto D, Madsen J, Bromfield E, Schulze-Bonhage A, Seelig D, Aschenbrenner-Scheibe R, Kahana M: Reset of human neocortical oscillations during a working memory task.Proc Nat Acad Sci USA 2003, 100:7931–7936.PubMedView ArticlePubMed Central

Steriade M, Jones EG, Llinas RR: Thalamic oscillations and signaling. Oxford, England: John Wiley and Sons; 1990.

Oprisan S, Buhusi C: Modelling pharmacological clock and memory patterns of interval timing in a striatal beat-frequency model with realistic, noisy neurons.Front Integr Neurosci 2011, 5:52.PubMedView ArticlePubMed Central

Oprisan SA, Buhusi CV: How noise contributes to time-scale invariance of interval timing.Phys Rev E 2013,87(5):052717.View Article

Oprisan SA, Dix S, Buhusi CV: Phase resetting and its implications for interval timing with intruders.Behav Process 2013, 1–10. in press

Buhusi CV, Oprisan SA: Time-scale invariance as an emergent property in a perceptron with realistic, noisy neurons.Behav Process 2013, 95:60–70. in pressView Article

Winfree A: The Geometry of Biological Time. New York: Springer-Verlag; 2001.View Article

Izhikevich EM: Phase equations for relaxation oscillators.SIAM J Appl Math 2000, 60:1789–1805.View Article

Guckenheimer J, Holmes P: Nonlinear Oscillations, Dynamical systems and Bifurcations of Vector Fields. New York: Springer; 1983.View Article

Kuramoto Y: Chemical Oscillations, Waves, and Turbulence. New York: Springer-Verlag; 1984.View Article

Kuznetsov YA: Elements of Applied Bifurcation Theory, 3 edition. New York: Springer; 2004.View Article

Ermentrout G: Losing amplitude and saving phase, Volume 66. Berlin - New York: Springer; 1986.

Papoulis A, Pillai SU: Probability, Random Variables and Stochastic Processes, 4 edition. USA: McGraw Hill; 2002.

Spiegel MR: Theory and Problems of Probability and Statistics. New York: McGraw-Hill; 1992.

Reyes A, Fetz E: How modes of interspike interval shortening by brief transient depolarizations in cat neocortical neurons.J Neurophys 1993, 69:1661–1672.

Tateno T, Harsch A, Robinson H: Threshold firing frequency-current relationships of neurons in rat somatosensory cortex: type 1 and type 2 dynamics.J Neurophys 2004, 92:2283–2299.View Article

Stein EM, Shakarchi R: Fourier Analysis: An Introduction. Princeton and Oxford: Princeton University Press; 2003.

Braun H, Wissing H, Schafer K, Hirsch M: Oscillation and noise determine signal transduction in shark multimodal sensory cells.Nature 1994, 367:270–273.PubMedView Article

Douglass J, Wilkens L, Pantazelou E, Moss F: Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance.Nature 1993, 365:337–340.PubMedView Article

Galan R, Fourcaud-Trocme N, Ermentrout GB, Urban NN: Correlation-induced synchronization of oscillations in olfactory bulb neurons.J Neurosci 2006, 26:3646–3655.PubMedView Article

Tateno T, Robinson H: Quantifying noise-induced stability of a cortical fast-spiking cell model with Kv3-channel-like current.Biosystems 2007,86(1–3):110–116.View Article

Ditlevsen S, Greenwood P: The Morris-Lecar neuron model embeds a leaky integrate-and-fire model.J Math Bio 2013,67(2):239–159.View Article

Killeen PR, Fetterman JG: A behavioral theory of timing.Psychol Rev 1988,95(2):274–95.PubMedView Article

Grossberg S, Schmajuk N: Neural dynamics of adaptive timing and temporal discrimination during associative learning.Neural Netw 1989, 2:79–102.View Article

Grossberg S, Merrill JW: A neural network model of adaptively timed reinforcement learning and hippocampal dynamics.Brain Res Cogn Brain Res 1992,1(1):3–38.PubMedView Article

Machado A: Learning the temporal dynamics of behavior.Psychol Rev 1997,104(2):241–65.PubMedView Article

Staddon JER, Higa JJ: Time and memory: towards a pacemaker-free theory of interval timing.J Exp Anal Behav 1999,71(2):215–251.PubMedView ArticlePubMed Central

Leon MI, Shadlen MN: Representation of time by neurons in the posterior parietal cortex of the macaque.Neuron 2003,38(2):317–327.PubMedView Article

Simen P, Balci F, deSouza L, Cohen JD, Holmes P: A model of interval timing by neural integration.J Neurosci 2011,31(25):9238–9253.PubMedView ArticlePubMed Central

Reutimann J, Yakovlev V, Fusi S, Senn W: Climbing neuronal activity as an event-based cortical representation of time.J Neurosci 2004, 24:3295–3303.PubMedView Article

Gallistel CR, Gibbon J: Time, rate, and conditioning.Psychol Rev 2000, 107:289–344.PubMedView Article

Karmarkar UR, Buonomano DV: Timing in the absence of clocks: encoding time in neural network states.Neuron 2007,53(3):427–438.PubMedView ArticlePubMed Central

Ermentrout GB: Type I membranes, phase resetting curves, and synchrony.Neural Comput 1996,8(5):979–1001.PubMedView Article

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.