Memory capacity of a random, recurrently connected network of neurons with multiple, biologically realistic facilitation and adaptation profiles
BMC Neuroscience volume 12, Article number: P115 (2011)
We developed a model of linear, integrate-and-fire neurons endowed with realistic firing rate facilitation and adaptation profiles (Figure 1B, green) based on parameters obtained from rodent cortical slice electrophysiology data . The equations of dynamics of each model neuron contained facilitating and adapting currents, proportional to the intracellular concentration of different ionic species, which were modulated by each neuron’s spiking history. The adapting input network projected in a feed-forward manner through a high dimensional, recurrently connected network of spiking neurons whose activity was then projected to a linear readout, firing-rate neuron. We sought to inspect the recurrently connected network’s capacity for memory by injecting a time-varying “input signal” current into the adapting network (Fig. 1B, red) and training the weights of the linear readout neuron so that its firing rate matched a teaching signal provided to the neuron; the teaching signal was a specified transformation of the input signal current to the adapting input network (Fig. 1B, blue).
Once trained, we could assess the memory capacity of the recurrently connected network. Specifically, we were interested in understanding the role of adaptation in extending the recurrently connected network’s capacity to remember the input. The limits of memory capacity in recurrently connected neural networks have been studied previously [2–4] but in networks lacking realistic adaptation and facilitation profiles. Including these firing-rate dependent currents should fundamentally alter the time-scale of the network dynamics and the memory network’s capacity for storing temporal signals. We studied the performance of the network for a variety of time varying signals and we analyzed its dependence on the inherent time constants of adaptation. We show one example in Figure 1A ,1B in which we found that the network is able to accurately generate a half-period time shifted version of a simple oscillatory input.
La Camera G, Rauch A, Thurbon D, Luscher HR, Senn W, Fusi S: Multiple time scales of temporal response in pyramidal and fast spiking cortical neurons. J. Neurophysiol. 2006, 6: 3448-3464. 10.1152/jn.00453.2006.
Rigotti M, Rubin DBD, Wang X-J, Fusi S: Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses. Front. of Comput. Neurosci. 2010, 4: 24.
Sussillo D, Abbott LF: Generating coherent patterns of activity from chaotic neural networks. Neuron. 2009, 63: 544-557. 10.1016/j.neuron.2009.07.018.
White OL, Lee DD, Sompolinsky HS: Short-term memory in orthogonal neural networks. Phys. Rev. Lett. 2004, 92 (14): 148102-10.1103/PhysRevLett.92.148102.
This work was supported by the Gatsby Foundation, the Kavli Foundation, DARPA SyNAPSE and the NSF Graduate Research Fellow Program.
About this article
Cite this article
DePasquale, B.D., Fusi, S. Memory capacity of a random, recurrently connected network of neurons with multiple, biologically realistic facilitation and adaptation profiles. BMC Neurosci 12 (Suppl 1), P115 (2011). https://doi.org/10.1186/1471-2202-12-S1-P115