- Poster presentation
- Open Access
Feedback in a hierarchical model of object recognition in cortex
BMC Neurosciencevolume 10, Article number: P355 (2009)
Substantial evidence exists showing V1/V2 cortical activity in response to illusory contours (e.g. Kanizsa's triangle). V1 represents information that correlates with visual perception but does not arise from the ordinary feedforward pathways (retina and LGN), suggesting this response is driven by feedback connections from higher-level areas. At the same time, several authors have emphasized the important role played by feedback connections in visual perception and have suggested hierarchical Bayesian inference as a plausible underlying interpretation [2–5]. The proposed model aims at providing a functional interpretation of the illusory contour phenomenon and, more generally, of the role of feedback connections in visual perception under the perspective of a Bayesian inference framework.
The model takes as a starting point the HMAX model, a well-known cortex-based object recognition model [6, 7], and shows how this feedforward architecture can also be interpreted in probabilistic terms and extended to include feedback using the Bayesian Belief Propagation algorithm. Feedforward responses are understood as probability distributions of the set of features at the different positions, which build up hierarchically obtaining at the top level the most probable object represented by the input image. Activity relating to the stored invariant prototype of this object is then fed back down the network and combined with the feedforward response at each level to obtain the resulting belief. However, high-level invariant object prototypes generate ambiguous and diffuse feedback that needs refinement. The disambiguation process, based on cues from existing feedforward responses, uses a local extrapolation algorithm that exploits co-linearity, co-orientation and good continuation to guide and adapt feedback.
Simulation results show successful feedforward object recognition, including cases of occluded and illusory images. Recognition is both position and size invariant. The model also provides a functional interpretation of feedback connectivity which accounts for several observed phenomena. Model responses qualitatively match representations in early visual cortex of occluded and illusory contours ; and fMRI data showing that high-level object recognition reduces activity in lower areas . Additionally a dynamic mechanism for illusory contour formation is proposed which can adapt a single high-level object prototype to Kanizsa's illusory figures of different sizes, shapes and positions. The mechanism is supported by experimental studies that suggest the interaction between contextual feedback signals and local evidence in V1 is responsible for contour completion [1, 9]. By imposing top-level priors the model can also simulate the effects of spatial attention, priming and visual search.
T Nguyen M: Dynamics of subjective contour formation in the early visual cortex. Proc Natl Acad Sci USA. 2001, 98: 1907-1911. 10.1073/pnas.031579998.
Friston K: Learning and inference in the brain. Neural Netw. 2003, 16: 1325-1352. 10.1016/j.neunet.2003.06.005.
Lee TS, Mumford D: Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis. 2003, 20: 1434-1448. 10.1364/JOSAA.20.001434.
Rao RPN, Ballard DH: Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computat. 1997, 9: 721-763. 10.1162/neco.1922.214.171.1241.
Sillito AM, Cudeiro J, Jones HE: Always returning: feedback and sensory processing in visual cortex and thalamus. Trends Neurosci. 2006, 29: 307-316. 10.1016/j.tins.2006.05.001.
Cadieu C, Kouh M, Pasupathy A, Connor CE, Riesenhuber M, Poggio T: A model of V4 shape selectivity and invariance. J Neurophysiol. 2007, 98: 1733-1750. 10.1152/jn.01265.2006.
Riesenhuber M, Poggio T: Hierarchical models of object recognition in cortex. Nat Neurosci. 1999, 2: 1019-1025. 10.1038/14819.
Murray SO, Schrater P, Kersten D: Perceptual grouping and the interactions between visual cortical areas. Neural Netw. 2004, 17: 695-705. 10.1016/j.neunet.2004.03.010.
Stanley DA, Rubin N: fMRI Activation in Response to Illusory Contours and Salient Regions in the Human Lateral Occipital Complex. Neuron. 2003, 37: 323-331. 10.1016/S0896-6273(02)01148-0.