Skip to main content
  • Poster presentation
  • Open access
  • Published:

Feedback in a hierarchical model of object recognition in cortex

Substantial evidence exists showing V1/V2 cortical activity in response to illusory contours (e.g. Kanizsa's triangle)[1]. V1 represents information that correlates with visual perception but does not arise from the ordinary feedforward pathways (retina and LGN), suggesting this response is driven by feedback connections from higher-level areas. At the same time, several authors have emphasized the important role played by feedback connections in visual perception and have suggested hierarchical Bayesian inference as a plausible underlying interpretation [2–5]. The proposed model aims at providing a functional interpretation of the illusory contour phenomenon and, more generally, of the role of feedback connections in visual perception under the perspective of a Bayesian inference framework.

The model takes as a starting point the HMAX model, a well-known cortex-based object recognition model [6, 7], and shows how this feedforward architecture can also be interpreted in probabilistic terms and extended to include feedback using the Bayesian Belief Propagation algorithm. Feedforward responses are understood as probability distributions of the set of features at the different positions, which build up hierarchically obtaining at the top level the most probable object represented by the input image. Activity relating to the stored invariant prototype of this object is then fed back down the network and combined with the feedforward response at each level to obtain the resulting belief. However, high-level invariant object prototypes generate ambiguous and diffuse feedback that needs refinement. The disambiguation process, based on cues from existing feedforward responses, uses a local extrapolation algorithm that exploits co-linearity, co-orientation and good continuation to guide and adapt feedback.

Simulation results show successful feedforward object recognition, including cases of occluded and illusory images. Recognition is both position and size invariant. The model also provides a functional interpretation of feedback connectivity which accounts for several observed phenomena. Model responses qualitatively match representations in early visual cortex of occluded and illusory contours [1]; and fMRI data showing that high-level object recognition reduces activity in lower areas [8]. Additionally a dynamic mechanism for illusory contour formation is proposed which can adapt a single high-level object prototype to Kanizsa's illusory figures of different sizes, shapes and positions. The mechanism is supported by experimental studies that suggest the interaction between contextual feedback signals and local evidence in V1 is responsible for contour completion [1, 9]. By imposing top-level priors the model can also simulate the effects of spatial attention, priming and visual search.

References

  1. T Nguyen M: Dynamics of subjective contour formation in the early visual cortex. Proc Natl Acad Sci USA. 2001, 98: 1907-1911. 10.1073/pnas.031579998.

    Article  Google Scholar 

  2. Friston K: Learning and inference in the brain. Neural Netw. 2003, 16: 1325-1352. 10.1016/j.neunet.2003.06.005.

    Article  PubMed  Google Scholar 

  3. Lee TS, Mumford D: Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis. 2003, 20: 1434-1448. 10.1364/JOSAA.20.001434.

    Article  PubMed  Google Scholar 

  4. Rao RPN, Ballard DH: Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computat. 1997, 9: 721-763. 10.1162/neco.1997.9.4.721.

    Article  CAS  Google Scholar 

  5. Sillito AM, Cudeiro J, Jones HE: Always returning: feedback and sensory processing in visual cortex and thalamus. Trends Neurosci. 2006, 29: 307-316. 10.1016/j.tins.2006.05.001.

    Article  CAS  PubMed  Google Scholar 

  6. Cadieu C, Kouh M, Pasupathy A, Connor CE, Riesenhuber M, Poggio T: A model of V4 shape selectivity and invariance. J Neurophysiol. 2007, 98: 1733-1750. 10.1152/jn.01265.2006.

    Article  PubMed  Google Scholar 

  7. Riesenhuber M, Poggio T: Hierarchical models of object recognition in cortex. Nat Neurosci. 1999, 2: 1019-1025. 10.1038/14819.

    Article  CAS  PubMed  Google Scholar 

  8. Murray SO, Schrater P, Kersten D: Perceptual grouping and the interactions between visual cortical areas. Neural Netw. 2004, 17: 695-705. 10.1016/j.neunet.2004.03.010.

    Article  PubMed  Google Scholar 

  9. Stanley DA, Rubin N: fMRI Activation in Response to Illusory Contours and Salient Regions in the Human Lateral Occipital Complex. Neuron. 2003, 37: 323-331. 10.1016/S0896-6273(02)01148-0.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Salvador Dura.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Dura, S., Wennekers, T. & Denham, S. Feedback in a hierarchical model of object recognition in cortex. BMC Neurosci 10 (Suppl 1), P355 (2009). https://doi.org/10.1186/1471-2202-10-S1-P355

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-10-S1-P355

Keywords