Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Driving steady-state visual evoked potentials at arbitrary frequencies using temporal interpolation of stimulus presentation

BMC Neuroscience volume 16, Article number: 95 (2015) Cite this article

Abstract

Background

Steady-state visual evoked potentials have been utilized widely in basic and applied research in recent years. These oscillatory responses of the visual cortex are elicited by flickering stimuli. They have the same fundamental frequency as the driving stimulus and are highly sensitive to manipulations of attention and stimulus properties. While standard computer monitors offer great flexibility in the choice of visual stimuli for driving SSVEPs, the frequencies that can be elicited are limited to integer divisors of the monitor’s refresh rate.

Results

To avoid this technical constraint, we devised an interpolation technique for stimulus presentation, with which SSVEPs can be elicited at arbitrary frequencies. We tested this technique with monitor refresh rates of 85 and 120 Hz. At a refresh rate of 85 Hz, interpolated presentation produced artifacts in the recorded spectrum in the form of additional peaks not located at the stimulated frequency or its harmonics. However, at a refresh rate of 120 Hz, these artifacts did not occur and the spectrum elicited by an interpolated flicker became indistinguishable from the spectrum obtained by non-interpolated presentation of the same frequency.

Conclusions

Our interpolation technique eliminates frequency limitations of the common non-interpolated presentation technique and has many possible applications for future research.

Background

The steady-state visual evoked potential (SSVEP) is a continuous oscillatory response of the visual cortex which is elicited by a flickering stimulus and has the same temporal frequency as the driving stimulus [1–4]. It can be recorded by electro- or magnetoencephalography and has been widely used in basic and applied research in recent years. In particular, SSVEPs have been employed to study different aspects of selective attention such as spatial attention [5–10], feature-based attention [11–13], visual search [14], competitive stimulus interactions [15–17] and attentional function in healthy old age [18, 19]. Other studies have employed SSVEPs to assess processing of emotional stimuli [20–24] and faces [25, 26], binocular rivalry [27, 28], object processing [29, 30], and figure-ground separation [31]. SSVEPs have also been widely employed in the development of brain-computer interfaces [32, 33].

SSVEPs offer good signal-to-noise ratios, as the signal power is concentrated in a few discrete frequency bands. This allows for easy signal extraction by means of Fourier-transformation if temporally sustained effects are of interest. Dynamic changes in stimulus processing can also be studied by using time–frequency analysis techniques such as Gabor-Filters [34] or wavelets. A particularly powerful application of SSVEPs is the ‘frequency tagging’ technique, in which the cortical processing of multiple stimuli can be assessed simultaneously by flickering each stimulus at a specific frequency [3].

However, as stimulus presentation is necessarily synchronized to the monitor’s refresh rate, the choice of frequencies is severely restricted. For example, when using a monitor with a refresh rate of 60 Hz, a 30 Hz SSVEP can be elicited by presenting the stimulus for one frame and then switching it off for one frame (two frames cycle length) while two frames on and two frames off (four frames cycle length) result in a frequency of 60/4 = 15 Hz. At 60 Hz, this allows for frequencies of 30, 20, 15, 12, 10, 8.57, 7.5 Hz, etc. Using this approach, SSVEPs cannot be elicited at frequencies that are not integer divisors of the refresh rate.

Depending on the purpose of a particular study, the choice of frequencies may be restricted even further. One of the most basic such restrictions is not to use frequencies that are harmonics of other frequencies of concurrently presented stimuli. For example, if one stimulus is presented at 10 Hz, then it is not advisable to use 20 or 30 Hz for a second stimulus, as the harmonic of the 10 Hz stimulus would be superimposed on the SSVEP of the second stimulus. When perceptual differences between stimuli flickering at different rates are to be minimized [9], frequencies must be close to each other, which can only be accomplished at the lower frequencies in our 60 Hz example. Other restrictions apply when a high temporal resolution is required for the question at hand, as for example when studying cued shifts of attention [35–37]. When using Gabor-Filters or wavelets to analyze time-courses at different frequencies, the frequencies should be clearly separated in order to avoid crosstalk. If a Fourier-transform with a short window-length is used, then crosstalk can be avoided by using frequencies that have an integer number of cycles in the chosen time-window (e.g. in a 200 ms window, 10 and 15 Hz have 2 or 3 cycles, respectively). In other cases, it may be important to separate SSVEPs from frequency bands of the EEG carrying other signals, such as transient ERPs or the alpha-band, by choosing appropriate frequencies for the SSVEP. Last but not least, in some cases it might be desirable to use stimuli with equal on–off rations in order to equate stimulus luminance over time. If, for example, all stimuli are to have a 50/50 on–off ratio, then frequencies are limited to even integer divisors of the refresh rate.

Whatever the particular reasons for the choice of frequencies in an SSVEP study, any additional criteria further reduce the already limited number of potential frequencies. Especially in frequency-tagging studies with multiple stimuli presented at different frequencies, the practically available set of frequencies may be far from the theoretically ideal number and choice of frequencies. This is particularly the case in the development of brain-computer interfaces (BCIs), which allow a person to convey his or her intentions by attending to a particular stimulus. Here, the information transfer rate can be improved with higher numbers of stimuli (i.e. frequencies) and certain applications, such as spelling or typing numbers, ideally require a large number of stimuli [38].

To surpass these limitations, an approximation technique for stimulus presentation has recently been proposed, which allows for driving SSVEPs at frequencies that are not limited to integer divisors of the monitor’s refresh rate [39]. This technique interleaves stimulus sequences of different length to approximate a specific presentation rate. For example, a rate of 11 Hz would be approximated at a refresh rate of 60 Hz by interleaving cycles of five or six frames length (corresponding to 12 and 10 Hz, respectively). This approximation approach is successful in eliciting SSVEPs at the desired frequencies which are largely comparable to those that would be elicited by a traditional stimulation technique. However, it also elicits additional signal power at other interference frequencies [38]. Such artifacts of the stimulation technique may be irrelevant for some approaches, in which the entire analysis is limited to a few specific frequencies at which no interference occurs. However, for other applications such interference artifacts may be unacceptable. If, for example, the goal of a study is to concurrently assess SSVEPs and activity in naturally occurring frequency bands of the EEG (e.g. theta-, alpha- or gamma-band), then this frequency band should not be contaminated by such interference artifacts.

We here devised and tested an interpolation technique in order to drive SSVEPs at arbitrary frequencies that can be chosen independently of the screen refresh rate. Ideally, a stimulus interpolation technique should (1) robustly produce signal power at the desired frequency (and potentially its harmonics) and (2) not produce additional signal power in other frequency bands. In order to test our technique against these criteria, we presented stimuli flickering at four different frequencies using two different monitor refresh rates. This was done in such a way, that each frequency was elicited in the standard non-interpolated way at one refresh rate, while being interpolated at the other refresh rate.

If our technique satisfies the two above criteria, then the spectrum elicited when a frequency is driven non-interpolated at one refresh rate should be indistinguishable from the spectrum elicited when the same frequency is driven by interpolated stimulation at another refresh rate.

Methods

Subjects

Fifteen right-handed subjects (10 female, ages 19–30, average 23.8 years) with normal or corrected-to-normal visual acuity participated in the experiment after giving informed consent and received either a small financial bonus (6 € per hour) or credit points. All subjects were included in the statistical analysis. The study was conducted in accordance with the Declaration of Helsinki and the guidelines and requirements for electrophysiological studies of the ethics committee of the University of Leipzig.

Interpolation technique

A specific SSVEP-frequency can be elicited by presenting a stimulus for a certain number of frames and then switching it off for another number of frames. The elicited frequency is then equal to the monitor refresh rate divided by the total cycle length (number of frames ‘on’ plus number of frames ‘off’). For example, at a refresh rate of 120 Hz, a 10.0 Hz SSVEP can be elicited by flickering a stimulus with a cycle length of 12 frames (e.g. 6 frames on, 6 frames off). However, if the monitor refresh rate is 85 Hz, it is not possible to elicit an SSVEP at 10.0 Hz using this approach, as this would require a cycle length of 85/ 10 HZ = 8.5 frames. Using a 50/50 on–off ratio, this would require the stimulus to be on and off for 4.25 frames respectively, which is technically not possible. However, this can be approximated by presenting the stimulus at full intensity for 4 frames and then presenting it at 25 % intensity for one frame (4 + 0.25 = 4.25 frames on). After this, the stimulus would be off for another 3 frames and then be presented at 50 % intensity (0.75 + 3+0.5 = 4.25 frames off). So the impossible requirement to present a stimulus for a fractional duration of frames at each on–off reversal is approximated by presenting the stimulus for a whole frame at an intermediate intensity. Using this interpolated stimulation technique the time-averaged intensity of the stimulus remains unchanged. However, the technically impossible sharp transitions from on to off at time-points that do not coincide with the monitor’s refresh rate are replaced by transitions synchronous to the monitor’s refresh rate at intermediate stimulus intensities (Fig. 1b).

Fig. 1
figure 1

a Stimulus display. Participants performed a simple detection task at fixation while SSVEPs elicited by the flickering ring were recorded b Illustration of stimulus intensity as a function of time for the four employed frequencies at each of two monitor refresh rates. 10.0 and 15.0 Hz waveforms were non-interpolated at a refresh rate of 120 Hz and interpolated at 85 Hz. 10.625 and 14.167 Hz were non-interpolated at 85 Hz and interpolated at 120 Hz

Full size image

In the general case, our interpolation technique is defined as follows. With a monitor refresh rate R and a desired stimulus frequency f, the required cycle length λ is defined by:

$$\lambda = R/f$$
(1)

The stimulus intensity w (1:on, 0:off) in any given frame i can then be calculated as follows:

$$w = \left\{ {\begin{array}{*{20}l} {1,} \hfill & {if\;1 \le i\bmod \lambda \le r_{on} \lambda } \hfill \\ {r_{on} \lambda + 1 - i\bmod \lambda ,} \hfill & {if\;r_{on} \lambda < i\bmod \lambda < r_{on} \lambda + 1} \hfill \\ {0,} \hfill & {if\;r_{on} \lambda \le i\bmod \lambda } \hfill \\ {i\bmod \lambda ,} \hfill & {if\;i\bmod \lambda < 1} \hfill \\ \end{array} } \right.$$
(2)

where ron denotes the fraction of the stimulus cycle in which the stimulus is on (ron = 0.5 in the recordings reported here). Note that i modulo λ is the position within the current flicker cycle. The first line defines the frames in which the stimulus is on at full intensity, the second line the on–off transitions, the third line the off-frames and finally the fourth line defines the off–on transitions.

In order to present stimuli at intermediate intensities 0 < w <1 two further things need to be taken into account. First, the off-phase of a stimulus is not necessarily black but could be any arbitrary color Coff and thus intermediate stimulus intensities C must be a weighted average of the stimulus color Con and the background or ‘off’ color Coff. Second, the relationship between color values in a stimulation program Vin (e.g. RGB values) and the output of a computer monitor Vout is not linear, but defined by a power function with an exponent gamma (γ):

$$V_{out} \propto V_{in}^{\gamma }$$
(3)

The exponent γ depends on the specific graphics hardware and its settings and usually lies between 1.8 and 2.2 for standard computer equipment. Taking the two points above into account, the output color C can be computed as:

$$C = \left( {wC_{on}^{\gamma } + \left( {1 - w} \right)C_{off}^{\gamma } } \right)\!{^{1}\!/\!{\gamma}}$$
(4)

To test this interpolation technique, we recorded the EEG elicited by a ring flickering at four different frequencies in different conditions. The four frequencies were chosen within a frequency range commonly employed in SSVEP experiments in such a way that two of them could be presented non-interpolated at a monitor refresh rate of 85 Hz, but not at 120 Hz (10.625 and 14.167 Hz), while the two other frequencies could be presented non-interpolated at a monitor refresh rate of 120 Hz, but not at 85 Hz (10 and 15 Hz, see Fig. 1). If the differences introduced by the interpolation technique are sufficiently subtle to be imperceptible to the human brain, then the EEG elicited by interpolated and non-interpolated stimulation of the same frequency should be indistinguishable. Flicker at 60 Hz elicits robust phase locked activity in the primary visual cortex of humans and macaque monkeys [40], however the magnitude of such activity in humans is already strongly reduced at 72 Hz [41]. In light of these findings, we considered it unlikely that distortions produced by stimulus interpolation would be imperceptible at monitor refresh rates of 72 Hz or less. Therefore, we chose a somewhat higher frequency of 85 Hz as the lower refresh rate for our experiment and a rate of 120 Hz as the higher refresh rate, since this was the maximum rate available with our equipment.

Stimulus material and procedure

Stimulation was presented on a 19″ Belinea 10 60 75 cathode ray tube (CRT) monitor set to a resolution of 640 × 480 pixels and 32 bits per pixel color mode. At a viewing distance of 80 cm, the ring had an outer diameter corresponding to 8.1° degrees of visual angle and an inner diameter of 4.06°. The bars of the fixation cross had a length corresponding to 0.81° × 0.16°. The background had a luminance of 9.4 cd/m2 and the fixation cross and flickering ring had a luminance of 79.7 cd/m2 (Fig. 1a).

To ensure correct intermediate luminance values for interpolated flicker, luminance calibration and gamma correction was performed separately for 85 and 120 Hz refresh rates. This is important, as the same RGB color values do not generally produce the same luminance values for different screen modes. We empirically estimated γ by presenting different gray values statically and measuring their luminance, resulting in γ = 2.0 for both refresh rates. Stimulation was realized using Cogent Graphics (John Romaya, LON at the Wellcome Department of Imaging Neuroscience). In each trial, the flickering ring was presented for approximately 3340 ms (284 frames at 85 Hz and 401 frames at 120 Hz). Timestamps for each frame of stimulus presentation were stored in order to verify the accuracy of stimulus timing. We did not detect any dropped frames throughout the entire dataset.

To control the allocation of attention, participants performed a simple target detection task at fixation. Beginning from 300 ms after stimulation onset (after 26 frames at 85 Hz or 36 frames at 120 Hz), the length of either the horizontal or vertical bar of the fixation cross could briefly change by 0.12° of visual angle. Length decrements of either bar were defined as targets and required a detection response by pressing space bar. Responses to analogous length increments constituted false alarms. The duration of targets and distractors was about 50 ms (4 frames at 85 Hz or 6 frames at 120 HZ). Any combination of up to three targets and/or distractors could occur within a single trial and the onsets of successive targets or distractors were separated by at least 700 ms (59 frames at 85 Hz or 84 frames at 120 Hz). Responses occurring from 200 ms to 850 ms after the onset of targets or distractors were counted as hits or false alarms, respectively. Over the entire experiment, a total of 45 targets and 45 distractors were presented for each of the eight conditions (4 frequencies each presented at two different monitor refresh rates).

The experiment consisted of 480 trials (60 per condition) presented in 8 blocks of 60 trials each. Trials of all conditions were presented in random order with the constraint that any single block contained only trials presented at the same monitor refresh rate. This was done to prevent frequent switching of the screen mode. Blocks at 85 and 120 Hz monitor refresh rate were presented in random order. Responding hand was switched after the first 4 Blocks. Prior to recordings, participants performed one or two blocks of task training (average 1.3 blocks).

EEG recordings and analysis

Brain electrical activity was recorded non-invasively at a sampling rate of 256 Hz from 64 Ag/AgCl electrodes mounted in an elastic cap using an ActiveTwo amplifier system (BioSemi, Amsterdam, The Netherlands). Lateral eye movements were monitored with a bipolar outer canthus montage (horizontal electroocculogram). Vertical eye movements and blinks were monitored with a bipolar montage positioned below and above the right eye. Processing of EEG data was performed using the EEGLab toolbox [42] in combination with custom written procedures in Matlab (The Mathworks, Natick, MA, USA).

Analysis epochs were extracted from 100 ms before to 3400 ms after stimulation onset. All epochs were detrended (removal of mean and linear trends) and epochs with eye movements or blinks were rejected from further analysis. All remaining artifacts were corrected or rejected by means of an automated procedure using a combination of trial exclusion and channel approximation based on statistical parameters of the data [43]. This led to an average rejection rate of 10.6 % of all epochs, which did not differ between conditions. Subsequently, all epochs were re-referenced to average reference and averaged for each experimental condition.

To quantify the spectral content in each condition, analysis windows were defined that contained an integer number of cycles of the driven SSVEP frequency (28, 30, 40 and 42 cycles for 10.0, 10.6 14.1 and 15.0 Hz, respectively). All analysis windows began 400 ms after stimulation onset in order to exclude the evoked potential to stimulation onset and to allow the SSVEP sufficient time to build up. The resulting analysis windows lasted from 400 to 3200 ms (10.0 and 15.0 Hz) or to 3225 ms (10.6 and 14.1 Hz) after stimulation onset. The amplitude spectrum of the data in these time windows was obtained by taking the absolute value of the complex Fourier coefficients for each frequency and electrode separately. Iso-contour voltage maps of amplitudes at the frequencies of the elicited SSVEPs for each condition showed a narrow peak over occipital electrodes (Fig. 2a). Accordingly, electrode Oz was chosen for statistical analysis.

Fig. 2
figure 2

a Isocontour voltage maps of SSVEP amplitudes averaged over all subjects at the four stimulation frequencies for non-interpolated (top-row) and interpolated (bottom-row) stimulation; b grand-average spectrum (top) and q-values comparing amplitudes (middle) elicited by interpolated vs. non-interpolated stimulation at a refresh rate of 85 Hz reveal clear artifacts of the interpolation technique. A comparison of the variance of the spectrum elicited by interpolated vs. non-interpolated stimulation (bottom) reveals no differences, indicating that artifacts were elicited consistently across participants; c no artifacts were apparent when stimulation was interpolated at a refresh rate of 120 Hz. 0 dB corresponds to 1 µV

Full size image

In the following step, we compared the recorded amplitude spectrum between 0 and 48 Hz for each of the four pairs of conditions with the same SSVEP frequency (e.g. 10 Hz non-interpolated was compared to 10 Hz interpolated). In order to better encompass the large amplitude differences in this wide frequency band, all amplitudes were transformed to a decibel scale by taking the logarithm to a base of 10 and multiplying by 10 (e.g. 1 µV corresponds to 0 dB, 0.1 µV correspond to −10 dB, see Fig. 2b). The amplitudes (in dB) for each frequency above 0 Hz and below 48 Hz were compared by means of paired t-tests. Due to slightly different window lengths, this analysis comprised 134 different frequencies for 10.0 and 15.0 Hz and 135 frequencies for 10.6 and 14.1 Hz. To account for multiple comparisons, we controlled the false discovery rate (FDR) [44] by correcting p-values using the ‘mafdr’ function in Matlab (The Mathworks). The resulting q-values (i.e. corrected p-values) depicted in Fig. 2b are significant when they are smaller than or equal to 0.05. In order to test for possible differences in the variance between participants of the recorded spectrum, a Bartlett test was conducted analogously to the t-tests described above and using the same correction for multiple comparisons.

Results

Behavioral data

The behavioral performance of participants is displayed in Table 1. Participants performed the task reliably with average hit-rates above 90 %, average false alarm rates around 10 % and average reaction times just below 500 ms. One-factorial repeated measures ANOVAs using Greenhouse-Geyser Correction for non-sphericity were conducted separately for hit rates, false alarm rates and reaction times. None of the three measures of behavioral performance differed between experimental conditions [hit rate: F(3.691, 51.571) = 1.325; false alarm rate: F(2.880, 40.320) = 0.361; reaction time: F(4.019, 56.263) = 2.022; all p > 0.1].

Table 1 Mean hit and false alarm rates and reaction times for all conditions
Full size table

Electrophysiological data

Amplitude spectra and statistical results are depicted in Fig. 2. For each of the four SSVEP frequencies, the spectrum elicited with non-interpolated stimulation was compared against the spectrum elicited with interpolated stimulation.

For 10.0 Hz, interpolated stimulation presented at a monitor refresh rate 85 Hz elicited clear additional peaks in the spectrum, that were not present when 10 Hz SSVEPs were elicited by non-interpolated flicker at a refresh rate of 120 Hz (Fig. 2b). Pairwise t-tests for each frequency in the spectrum and corrected for multiple comparisons using the false discovery rate revealed significantly higher amplitudes at 5.0 Hz [t(14) = −6.550, q = 0.000845], 15.0 Hz [t(14) = −5.089, q = 0.00632] and 44.9 Hz [t(14) = −6.471, q = 0.000845]. Although additional peaks are also visible at 25 and 35 Hz, these were not significantly different from the amplitudes elicited with non-interpolated stimulation (see Fig. 2b).

Additional peaks were also visible in the spectrum when SSVEPs were elicited at 15.0 Hz using interpolated flicker at a refresh rate of 85 Hz, as compared to when 15.0 Hz SSVEPs were elicited by non-interpolated flicker at a refresh rate of 120 Hz. Significantly higher amplitudes were observed at 10.0 Hz [t(14) = −5.857, q = 0.00317], 20.0 Hz [t(14) = −4.263, q = 0.0200], 25.0 Hz [t(14) = −4.840, q = 0.00997] and 39.9 Hz [t(14) = −3.815, q = 0.0360)].

The variance across participants did not differ significantly between interpolated and non-interpolated stimulation at any point of the spectrum for any of the four SSVEP frequencies (Fig. 2b, c, bottom panels). This indicates that the pattern of presence or absence of interpolation artifacts was consistent across participants, because the presence of such artifacts in only some participants would have led to a higher variance than in the non-interpolated control condition.

To provide a more detailed depiction of the recorded data, the grand mean spectrograms were computed for each condition by means of a bank of Gabor-Filters [34] located at the 134 (10.0 and 15.0 Hz) or 135 (10.6 and 14.1 Hz) frequencies of the spectrum used for the main analysis (Fig. 3).

Fig. 3
figure 3

Spectrograms of the recorded data averaged over all subjects at the four stimulation frequencies for non-interpolated (top-row) and interpolated (bottom-row) stimulation. Additional signal power was elicited in specific frequency bands when stimulus presentation was interpolated at a refresh rate of 85 Hz (10 and 15 Hz), but not at a refresh rate of 120 Hz (10.63 and 14.17 Hz). 0 dB corresponds to 1 µV

Full size image

In summary, interpolated stimulation at a refresh rate of 85 Hz successfully elicited robust SSVEPs at the stimulated frequencies, which did not differ from those elicited by non-interpolated flicker. However, additional signal power was also elicited at other frequencies, which represents an artifact of the interpolation technique. A different picture emerged when SSVEPs were elicited at 10.6 and 14.1 Hz by interpolated stimulation with a refresh rate of 120 Hz. Here, the spectrum was indistinguishable from the one elicited by non-interpolated stimulation of the same frequencies at 85 Hz (Fig. 2c). The paired comparison yielded no significantly different amplitudes for any of the tested frequencies.

Discussion

We investigated the feasibility of eliciting SSVEPs by using an interpolated stimulation technique in order to overcome the restrictions of available frequencies inherent to no-interpolated stimulation. To verify the adequacy of our method, we compared the recorded spectrum to a control condition in which the same frequency was elicited at another monitor refresh rate without interpolation. An ideal interpolation technique should elicit spectra that are indistinguishable from those recorded without interpolation. Our results consistently showed that this was not the case for interpolation using a monitor refresh rate of 85 Hz: although the elicited SSVEP response in these conditions did not differ from recordings without interpolation, additional peaks at other frequencies were elicited which constitute an unwanted artifact of the interpolation. This was however not the case for interpolation at a refresh rate of 120 Hz, where amplitudes at the elicited SSVEP frequencies and all other frequencies were comparable to those elicited by non-interpolated stimulation. Thus it seems that the temporal resolution of processing in the early visual areas that have previously been identified as the sources of the SSVEP [12, 16, 45] is still high enough to detect the differences in interpolated flicker when presented at a refresh rate of 85 Hz, but not at 120 Hz.

We used our interpolation technique to approximate a square wave luminance flicker at high contrast. The elicited spectrum was indistinguishable from the one elicited by non-interpolated flicker when a refresh rate of 120 Hz, but not 85 Hz, was employed. This implies that a refresh rate of 120 Hz is sufficient to interpolate stimulus presentation with our technique without eliciting unwanted artifacts in the spectrum. It should be noted that we tested our technique under ‘unfavorable’ conditions that were likely to reveal artifacts in the spectrum. Such artifacts may be less evident at lower stimulus contrast or if a smoother stimulus waveform than a square wave (e.g. a sine wave) was approximated. Also, luminance flicker can be perceived at higher frequencies than chromatic flicker [46]. Therefore, interpolating the flicker of chromatic stimuli of equal luminance as the background should produce less artifacts, and may thus be feasible at refresh rates lower than 120 Hz.

Other authors have recently proposed a different approximation technique to elicit SSVEPs at frequencies independent of the monitor refresh rate [38, 39]. This technique elicits robust SSVEPs at the desired frequencies and is slightly simpler to implement than ours, as it does not require intermediate stimulus intensities. However, our technique is superior in that it does not produce artifacts at interference frequencies as long as a refresh rate of 120 Hz is utilized. This difference may be critical for applications that also measure activity in other frequency bands (e.g. alpha, gamma) than those at which SSVEPs are elicited or when ERPs to discrete events interleaved in the SSVEP stimulation are to be measured.

We tested our interpolation technique for frequencies in the range between 10 and 15 Hz, which is often utilized in SSVEP experiments. SSVEPs can be elicited at lower frequencies too. However the frequency range below 10 Hz is of less interest for interpolated stimulation, because non-interpolated stimulation already offers much more flexibility in this range. For example, at a refresh rate of 120 Hz, the narrow frequency band between 4 and 6 Hz allows for 11 different frequencies to be driven using non-interpolated stimulation. Our interpolation technique is of high utility in cases where temporal changes in the processing of multiple stimuli are of interest. In such cases, higher frequencies are preferable because they allow for better temporal resolution. However, even at a refresh rate of 120 Hz, the wide frequency band from 10 to 60 Hz only contains 11 different frequencies that can be elicited by non-interpolated stimulation. Of these, five frequencies are higher harmonics of other frequencies, thus only leaving 6 frequencies that can be utilized together. Once other constraints are taken into consideration (e.g. equal on–off ratios, sufficient separation in frequency-space to avoid crosstalk, avoiding specific frequency bands; see introduction), the availability of frequencies is reduced even more thus rendering experiments that aim to investigate rapid dynamic changes in the processing of more than 2–3 stimuli infeasible without temporal interpolation of stimulus presentation.

It should be noted that our interpolation technique is in not limited to the simple black and white stimuli employed here. By applying Eq. (4) to the red, green and blue (RGB) values of a stimulus separately, this procedure can be utilized for flickering stimuli of any arbitrary color against a background of any arbitrary color. Furthermore, stimuli do not have to be of uniform color. For example, a bitmap image flickering against a background (or two alternating bitmap images) can be implemented by applying Eq. (4) to each pixel separately. Also, the phase of the stimulation can be shifted by any desired angle φ (0 < = φ < 2π). If we define j as

$$j = \left( i + \lambda \phi/ 2\pi \right)\bmod \lambda$$
(5)

and insert j into Eq. (2). Stimulus intensity w of a waveform shifted by an arbitrary phase φ is given by

$$w = \left\{ {\begin{array}{*{20}l} {1,} \hfill & {if\;1 \le j \le r_{on} \lambda } \hfill \\ {r_{on} \lambda + 1 - j,} \hfill & {if\;r_{on} \lambda < j < r_{on} \lambda + 1} \hfill \\ {0,} \hfill & {if\;r_{on} \lambda \le j} \hfill \\ {j,} \hfill & {if\;j < 1} \hfill \\ \end{array} } \right.$$
(6)

In conclusion, we devised and tested an interpolation technique that, using Eq. (6) allows to drive SSVEPs at any frequency up to half the monitor’s refresh rate with arbitrary on/off ratio (as defined by ron) and phase φ. At refresh rates of 120 Hz, this interpolation technique elicited SSVEPs that are indistinguishable from those elicited by non-interpolated flicker without producing any detectable artifacts in other parts of the spectrum. This technique thus portends many future applications in both basic and applied research.

References

  1. Regan D. Human brain electrophysiology: evoked potentials and evoked magnetic fields in science and medicine. New York: Elsevier; 1989.

    Google Scholar 

  2. Norcia A, Appelbaum L, Ales J, Cottereau B, Rossion B. The steady-state visual evoked potential in vision research: a review. J Vis. 2015;15(6):4:1–46.

  3. Andersen SK, Müller MM, Hillyard SA. Tracking the allocation of attention in visual scenes with steady-state evoked potentials. In: Posner MI, editor. Cognitive neuroscience of attention. 2nd ed. New York: Guilford; 2011. p. 197–216.

    Google Scholar 

  4. Di Russo F, Teder-Sälejärvi W, Hillyard SA. Steady-state VEP and attentional visual processing. In: Zani A, Proverbio AM, editors. The cognitive electrophysiology of mind and brain. New York: Academic Press; 2002. p. 259–73.

    Google Scholar 

  5. Itthipuripat S, Garcia JO, Serences JT. Temporal dynamics of divided spatial attention. J Neurophysiol. 2013;109(9):2364–73.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Morgan ST, Hansen JC, Hillyard SA. Selective attention to stimulus location modulates the steady-state visual evoked potential. Proc Natl Acad Sci USA. 1996;93(10):4770–4.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  7. Müller MM, Hübner R. Can the spotlight of attention be shaped like a doughnut ? Evidence from steady-state visual evoked potentials. Psychol Sci. 2002;13(2):119–24.

    Article  PubMed  Google Scholar 

  8. Müller MM, Malinowski P, Gruber T, Hillyard SA. Sustained division of the attentional spotlight. Nature. 2003;424:309–12.

    Article  PubMed  CAS  Google Scholar 

  9. Störmer VS, Winther GN, Li S, Andersen SK. Sustained multifocal attentional enhancement of stimulus processing in early visual areas predicts tracking performance. J Neurosci. 2013;33(12):5346–51.

    Article  PubMed  CAS  Google Scholar 

  10. Toffanin P, de Jong R, Johnson A, Martens S. Using frequency tagging to quantify attentional deployment in a visual divided attention task. Int J Psychophysiol. 2009;72(3):289–98.

    Article  PubMed  Google Scholar 

  11. Andersen SK, Hillyard SA, Müller MM. Global facilitation of attended features is obligatory and restricts divided attention. J Neurosci. 2013;33(46):18200–7.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. Andersen SK, Müller MM, Hillyard SA. Color-selective attention need not be mediated by spatial attention. J Vis. 2009;9(6):1–7.

    Article  PubMed  Google Scholar 

  13. Andersen SK, Müller MM, Hillyard SA. Attentional selection of feature conjunctions is accomplished by parallel and independent selection of single features. J Neurosci. 2015;35(27):9912–9.

    Article  PubMed  CAS  Google Scholar 

  14. Painter DR, Dux PE, Travis SL, Mattingley JB. Neural responses to target features outside a search array are enhanced during conjunction but not unique-feature search. J Neurosci. 2014;34(9):3390–401.

    Article  PubMed  CAS  Google Scholar 

  15. Keitel C, Andersen SK, Quigley C, Muller MM. Independent effects of attentional gain control and competitive interactions on visual stimulus processing. Cereb Cortex. 2013;23(4):940–6.

    Article  PubMed  Google Scholar 

  16. Fuchs S, Andersen SK, Gruber T, Müller MM. Attentional bias of competitive interactions in neuronal networks of early visual processing in the human brain. NeuroImage. 2008;41(3):1086–101.

    Article  PubMed  Google Scholar 

  17. Andersen SK, Müller MM, Martinovic J. Bottom-up biases in feature-selective attention. J Neurosci. 2012;32(47):16953–8.

    Article  PubMed  CAS  Google Scholar 

  18. Quigley C, Andersen SK, Muller MM. Keeping focused: sustained spatial selective visual attention is maintained in healthy old age. Brain Res. 2012;1469:24–34.

    Article  PubMed  CAS  Google Scholar 

  19. Quigley C, Andersen SK, Schulze L, Grunwald M, Müller MM. Feature-selective attention: evidence for a decline in old age. Neurosci Lett. 2010;474(1):5–8.

    Article  PubMed  CAS  Google Scholar 

  20. Deweese MM, Bradley MM, Lang PJ, Andersen SK, Mueller MM, Keil A. Snake fearfulness is associated with sustained competitive biases to visual snake features: hypervigilance without avoidance. Psychiatry Res. 2014;219(2):329–35.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hindi Attar C, Andersen SK, Müller MM. Time course of affective bias in visual attention: convergent evidence from steady-state visual evoked potentials and behavioral data. NeuroImage. 2010;53(4):1326–33.

    Article  PubMed  Google Scholar 

  22. Keil A, Moratti S, Sabatinelli D, Bradley MM, Lang PJ. Additive effects of emotional content and spatial selective attention on electrocortical facilitation. Cereb Cortex. 2005;15(8):1187–97.

    Article  PubMed  Google Scholar 

  23. McTeague LM, Shumen JR, Wieser MJ, Lang PJ, Keil A. Social vision: sustained perceptual enhancement of affective facial cues in social anxiety. Neuroimage. 2011;54(2):1615–24.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wieser MJ, McTeague LM, Keil A. Sustained preferential processing of social threat cues: bias without competition? J Cogn Neurosci. 2011;23(8):1973–86.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Rossion B, Boremanse A. Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. J Vision. 2011;11(2):16.

    Article  Google Scholar 

  26. Ales JM, Farzin F, Rossion B, Norcia AM. An objective method for measuring face detection thresholds using the sweep steady-state visual evoked response. J Vision. 2012;12(10):18.

    Article  Google Scholar 

  27. Srinivasan R, Russell DP, Edelman GM, Tononi G. Increased synchronization of neuromagnetic responses during conscious perception. J Neurosci. 1999;19(13):5435–48.

    PubMed  CAS  Google Scholar 

  28. Srinivasan R, Petrovic S. MEG phase follows conscious perception during binocular rivalry induced by visual stream segregation. Cereb Cortex. 2006;16(5):597–608.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Martens U, Trujillo-Barreto N, Gruber T. Perceiving the tree in the woods: segregating brain responses to stimuli constituting natural scenes. J Neurosci. 2011;31(48):17713–8.

    Article  PubMed  CAS  Google Scholar 

  30. Kaspar K, Hassler U, Martens U, Trujillo-Barreto N, Gruber T. Steady-state visually evoked potential correlates of object recognition. Brain Res. 2010;1343:112–21.

    Article  PubMed  CAS  Google Scholar 

  31. Appelbaum LG, Norcia AM. Attentive and pre-attentive aspects of figural processing. J Vis. 2009;9(11):1–12.

    Article  PubMed  Google Scholar 

  32. Kelly SP, Lalor EC, Reilly RB, Foxe JJ. Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication. IEEE Trans Neural Syst Rehabil Eng. 2005;13(2):172–8.

    Article  PubMed  Google Scholar 

  33. Zhang D, Maye A, Gao X, Hong B, Engel AK, Gao S. An independent brain-computer interface using covert non-spatial visual selective attention. J Neural Eng. 2010;7(1):16010.

    Article  PubMed  Google Scholar 

  34. Gabor D. Theory of communication. J Inst Elec Eng. 1946;93:429–41.

    Google Scholar 

  35. Müller MM, Teder-Sälejärvi W, Hillyard SA. The time course of cortical facilitation during cued shifts of spatial attention. Nat Neurosci. 1998;1(7):631–4.

    Article  PubMed  Google Scholar 

  36. Andersen SK, Müller MM. Behavioral performance follows the time course of neural facilitation and suppression during cued shifts of feature-selective attention. Proc Natl Acad Sci USA. 2010;107(31):13878–82.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kashiwase Y, Matsumiya K, Kuriki I, Shioiri S. Time courses of attentional modulation in neural amplification and synchronization measured with steady-state visual-evoked potentials. J Cogn Neurosci. 2012;24(8):1779–93.

    Article  PubMed  Google Scholar 

  38. Nakanishi M, Wang Y, Wang Y, Mitsukura Y, Jung T. Generating visual flickers for eliciting robust steady-state visual evoked potentials at flexible frequencies using monitor refresh rate. PLoS One. 2014;9(6):e99235.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  39. Wang Y, Wang Y, Jung T. Visual stimulus design for high-rate SSVEP BCI. Electron Lett. 2010;46(15):1057–8.

    Article  Google Scholar 

  40. Williams P, Mechler F, Gordon J, Shapley R, Hawken M. Entrainment to video displays in primary visual cortex of macaque and humans. J Neurosci. 2004;24(38):8278–88.

    Article  PubMed  CAS  Google Scholar 

  41. Lyskov E, Ponomarev V, Sandstrom M, Mild K, Medvedev S. Steady-state visual evoked potentials to computer monitor flicker. Int J Psychophysiol. 1998;28(3):285–90.

    Article  PubMed  CAS  Google Scholar 

  42. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134:9–21.

    Article  PubMed  Google Scholar 

  43. Junghöfer M, Elbert T, Tucker DM, Rockstroh B. Statistical control of artifacts in dense array EEG/MEG studies. Psychophysiology. 2000;37(4):523–32.

    Article  PubMed  Google Scholar 

  44. Benjamini Y, Hochberg Y. Controlling the false discovery rate—a practical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol. 1995;57(1):289–300.

    Google Scholar 

  45. Di Russo F, Pitzalis S, Aprile T, Spitoni G, Patria F, Stella A, Spinelli D, Hillyard SA. Spatiotemporal analysis of the cortical sources of the steady-state visual evoked potential. Hum Brain Mapp. 2007;28(4):323–34.

    Article  PubMed  Google Scholar 

  46. Wagner G, Boynton RM. Comparison of four methods of heterochromatic photometry. J Opt Soc Am. 1972;62:1508–15.

    Article  PubMed  CAS  Google Scholar 

Download references

Authors’ contributions

Both authors contributed to conception and design of the study. SKA wrote stimulation programs, recorded and analysed the data. SKA and MM wrote the manuscript. Both authors read and approved the final manuscript.

Acknowledgements

We thank Renate Zahn for help with data collection. This work was supported by Deutsche Forschungsgemeinschaft (AN 841/1-1, MU 972/20-1). We would like to thank A. Trujillo-Ortiz, R. Hernandez-Walls, A. Castro-Perez and K. Barba-Rojo (Universidad Autonoma de Baja California) for making Matlab code for non-sphericity corrections freely available.

Availability of data and materials

Copies of the data may be obtained from the corresponding author (SKA).

Competing interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations

  1. School of Psychology, University of Aberdeen, William Guild Building, Aberdeen, AB24 3FX, UK

    Søren K. Andersen

  2. Institute of Psychology, University of Leipzig, Neumarkt 9-19, 04109, Leipzig, Germany

    Matthias M. Müller

Authors
  1. Søren K. Andersen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias M. Müller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthias M. Müller.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Andersen, S.K., Müller, M.M. Driving steady-state visual evoked potentials at arbitrary frequencies using temporal interpolation of stimulus presentation. BMC Neurosci 16, 95 (2015). https://doi.org/10.1186/s12868-015-0234-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12868-015-0234-7

Keywords

BMC Neuroscience

ISSN: 1471-2202

Contact us