Biologically realistic excitatory and inhibitory cell properties emerge from a sparse coding network
© Zhu and Rozell; licensee BioMed Central Ltd. 2012
Published: 16 July 2012
Neurons in the primary visual cortex exhibit a baffling array of tuning properties, often unaccountable by the classical linear feedforward model. Specifically, excitatory neurons display a number of nonlinear effects collectively known as non-classical receptive field (nCRF) effects , and inhibitory neurons have diverse orientation tuning properties . Furthermore, excitatory cells outnumber inhibitory cells by a ratio of 9:1 , yet the excitatory and inhibitory drives are balanced.
Efficient coding models of early vision have been shown to be able to explain key features of linear filtering properties  and some single cell nonlinear effects . However, population statistics of nonlinear properties have not been studied in these models. In addition, inhibitory cells were not typically modeled.
Here we demonstrate that many of the aforementioned excitatory cell and inhibitory cell properties emerge naturally from a network that implements sparse coding. To be specific, several nCRF effects including surround suppression, contrast invariant orientation tuning, and cross orientation suppression emerge in the excitatory cell population as a result of sparse coding strategy; the excitatory to inhibitory cell ratio could be understood largely as a result of the overcompletness of representation; moreover, a subpopulation of inhibitory interneurons exhibit orientation tuning due to sparse recurrent connections with the principal cells; another subpopulation displays untuned properties due to low rank connectivity patterns. We also demonstrate that the network exhibits balanced excitation and inhibition, as a result of the receptive field structure.
We simulated a population of 2048 excitatory neurons with graded response described by the dynamics of locally competitive algorithm (LCA; ), which converges to the sparse coding representation at steady state. Inhibitory interneurons were described by linear units. The low rank and sparse recurrent connectivity pattern was a result of low rank plus sparse decomposition  of the LCA connectivity matrix. Non-classical receptive field effects were studied by presenting bar and drifting grating stimuli to the simulated network. Receptive fields of the inhibitory cells were mapped by sparse dots patterns.
- Seriès P, Lorenceau J, Frégnac Y: The "silent" surround of V1 receptive fields: theory and experiments. Journal of physiology-Paris. 2003, 97: 453-474. 10.1016/j.jphysparis.2004.01.023.View ArticleGoogle Scholar
- Hirsch JA, Martinez LM, Pillai C, Alonso J-M, Wang Q, Sommer FT: Functionally distinct inhibitory neurons at the first stage of visual cortical processing. Nat Neurosci. 2003, 6: 1300-1308. 10.1038/nn1152.View ArticlePubMedGoogle Scholar
- Meyer HS, Schwarz D, Wimmer VC, Schmitt AC, Kerr JND, Sakmann B, Helmstaedter M: Inhibitory interneurons in a cortical column form hot zones of inhibition in layers 2 and 5A. Proceedings of the National Academy of Sciences. 2011, 108: 16807-16812. 10.1073/pnas.1113648108.View ArticleGoogle Scholar
- Olshausen B, Field D: Sparse coding with an overcomplete basis set: A strategy employed by V1?. Vision research. 1997, 37: 3311-3325. 10.1016/S0042-6989(97)00169-7.View ArticlePubMedGoogle Scholar
- Zhu M, Rozell CJ: Sparse coding models demonstrate some non-classical receptive field effects. Nineteenth Annual Computational Neuroscience Meeting. 2010Google Scholar
- Rozell C, Johnson D, Baraniuk R, Olshausen B: Sparse coding via thresholding and local competition in neural circuits. Neural Computation. 2008, 20: 2526-2563. 10.1162/neco.2008.03-07-486.View ArticlePubMedGoogle Scholar
- Lin Z, Chen M, Ma Y: The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices. ArXiv e-prints. 2010Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.