Skip to main content


We're creating a new version of this page. See preview

  • Poster Presentation
  • Open Access

Dimensionality reduction for discrimination: removal of common structures with iSTAC

BMC Neuroscience201011 (Suppl 1) :P176

  • Published:


  • Dimensionality Reduction
  • Unconditioned Stimulus
  • Gaussian White Noise
  • Neural Response
  • Theoretical Property

Many neuroscience experiments, particularly those directed at exploring the relationship between sensory input and neural responses through various uses of a response conditioned stimulus ensemble (RCSE) use gaussian white noise (GWN) stimuli. The use of GWN allows simplification of the analysis, since this is some sort of comparison between the RCSE and the distribution of undconditioned or raw stimuli (The UCSE). In the GWN case, the UCSE is known, and has the simplifying properties of being uncorrelated and normally distributed. Ths is useful, but using the theoretical properties of GWN inputs too aggressively can lead to errors stemming from the fact that real inputs are only approximately Gaussian and white. In particular, all stimuli used in computer driven experiments are band limited. Even a "purely" white stimulus will be band limited due to the constraints of being discretely sampled and finitely long, but in a typical experiment, explicit band limits are applied by the experimenters, which are more restrictive than the limits due to sampling.

Band limited stimuli have an auto-correlation structure, which can be quite substantial for band widths of ethological interest. For example, the cercal sensory system of crickets detects air movements at frequencies typically less than 200 Hz. The covariance matrix of a 5-200 Hz band-limited signal is shown in Figure 1A. We use a model cell to select a RCSE subset of that stimulus, presenting its mean and covariance in panels 1B and 1C. It is obvious from looking at 1C that a large portion of its structure is determined by the covariance of the UCSE in 1A. This affects the quality of models built to explain the structure of the RCSE and provide insight into neural processing.

We designed an approach with which to reduce the effects of nontrivial UCSE structure in the analysis of the RCSE. The main goal of that approach was to remove structures that were common in both sets and thus did not contribute to discriminating between the conditioned and unconditioned stimulus. Results of applying this approach to the set described above can be seen in Figure 1D and 1E The model mean shown in 1D is very similar to the mean obtained before the correction. However, the covariance seen in 1E shows that the method successfully removes most of the common structure, previously observed in 1A and 1C and retains and enhances covariance structure that helps in discriminating between the RCSE and the UCSE.

We employed the iSTAC method [1] for that purpose. In its original use, iSTAC was designed to find a small subspace that maintains as much as possible of the Kullback-Leibler (KL) divergence between two distributions. For the dimensionality reduction application here, we used iSTAC to discard as much as possible of the common signal structure discussed earlier, by removing the subspace that does not affect the KL divergence much. In Figure 1 we show the results after removing about half of the dimensions, while still retaining 90% of the overall variance of the stimulus.
Figure 1
Figure 1

A. Structure of the unconditional covariance. B. conditional mean and C. covariance of a model cell. D. conditional mean and E. covariance after iSTAC compression.

Authors’ Affiliations

Center for Computational Biology, Montana State University, Bozeman, MT, USA


  1. Pillow JW, Simoncelli EP: Dimensionality reduction in neural models: An information-theoretic generalization of spike-triggered average and covariance analysis. J Vis. 2006, 6: 414-428. 10.1167/6.4.9.View ArticlePubMedGoogle Scholar


© Cummins and Dimitrov; licensee BioMed Central Ltd. 2010

This article is published under license to BioMed Central Ltd.