Skip to main content
  • Poster presentation
  • Open access
  • Published:

A hierarchical predictive coding model of visual processing

The roles for top-down signals in visual processing have been intensively studied experimentally in the last few years and have also been modeled theoretically. In particular, predictive coding, where feedback from higher cortical areas carries expectations of lower level activity, has been shown to explain the emergence of extra-classical receptive field effects [1].

Since top-down predictions cannot be independent of the bottom-up input, the interpretation of a visual scene must be an iterative process in which the initial activation pattern relaxes to a solution matching expectation with sensory experience. However, in models, such as the one of Rao and Ballard, where top-down effects propagate over all layers of the visual hierarchy, the relaxation times are too slow compared to the time scale of visual processing. Our starting point is the mathematical observation that in predictive coding relaxation results in each higher layer essentially performing principal component analysis of the activity in the preceding lower layer. We show how this analysis can be done without propagating top-down effects through the entire visual hierarchy. In our model, not only the top-down connectivity, but also the effective resulting feedback is confined to proximal layers, yielding fast relaxation. This suggests a way for the visual system to square the need for fast processing with the integration of top-down clues.

We also make it explicit that in a biologically plausible implementation each layer requires both coding for stimulus representation and for the prediction error. This sheds new light on the interpretation of activation patterns observed in V4 which have seemed impossible to reconcile with predictive coding [2].

References

  1. Rao RP, Ballard DH: Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci. 1999, 2 (1): 9-10. 10.1038/4580.

    Article  Google Scholar 

  2. Rainer G, Lee H, Logothetis NK: The effect of learning on the function of monkey extrastriate visual cortex. PLoS Biol. 2004, 2 (2): E44-10.1371/journal.pbio.0020044.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Boris Vladimirskiy.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Vladimirskiy, B., Senn, W. & Urbanczik, R. A hierarchical predictive coding model of visual processing. BMC Neurosci 9 (Suppl 1), P111 (2008). https://doi.org/10.1186/1471-2202-9-S1-P111

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-9-S1-P111

Keywords