Capacity measurement of a recurrent inhibitory neural network
BMC Neuroscience volume 12, Article number: P196 (2011)
Inhibitory neurons are considered to play a central role as rhythm generator and in shaping feed-forward receptive fields. While much attention has been paid to such effects on excitatory neurons, little is done to study these inhibitory neurons' ability to directly process information. Here we present a model that investigates the computational capacity of a recurrent inhibitory neural network.
Our work focuses on quantifying the performance of a recurrent network of inhibitory integrate-and-fire neurons in canonical classification tasks. The model begins with parallel independent excitatory Poisson inputs connected to the recurrent network. Then, the network output is feed-forwardly directed to a read-out linear classifier. An identical network, but with zero synaptic connectivity, is set up for benchmarking. The analysis is then conducted by comparing the capacities of both setups, at 95% accuracy, as a function of parameters such as inhibitory weight, network size, etc.
It is found that, in general, neurons with faster time constants provide better computational power. Furthermore, there is an optimum weight amongst the inhibitory neurons that yields at least a 20% network performance improvement (Figure 1). The inhibition plays the role of suppressing overdriven, stereotypical firing behavior to render efficient sparse encoding of temporal information. This illustrates that the nonlinearity of a recurrent, dynamical network possesses more computational capacity than a simple feed-forward linear expansion provided by the non-connected network [1, 2].
Maass W, Natschläger T, Markram H: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 2002, 14: 2531-2560. 10.1162/089976602760407955.
Jäger H, Haas H: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science. 2004, 304: 78-80. 10.1126/science.1091277.
About this article
Cite this article
Yuan, CW., Leibold, C. Capacity measurement of a recurrent inhibitory neural network. BMC Neurosci 12 (Suppl 1), P196 (2011). https://doi.org/10.1186/1471-2202-12-S1-P196