Structural plasticity and associative memory in balanced neural networks with spike-time dependent inhibitory plasticity
© Sinha et al. 2015
Published: 18 December 2015
In recent work, Vogels and collaborators demonstrated the ability of spike-time dependent inhibitory plasticity to stabilise recurrent spiking neural networks by balancing out the excitatory input received by neurons in the network with the required amount of inhibition . Further, as an application of this unsupervised balance, they showed that such a network can operate as a non-attractor associative memory, by being able to store patterns that become indistinguishable from the background activity of the network, but that can be recalled successfully by external stimuli.
In other research, also related to homoeostasis in neuronal networks, Butz and colleagues investigated the rewiring of deafferentated neurons driven by homoeostatic structural plasticity [2, 3]. Their work, based on biological observations of restructuring in the visual cortex [4, 5], suggests that neurons endeavour to maintain an appropriate level of electrical activity by adjusting the number of synaptic contacts they make. In order to remedy the loss in electrical activity experienced by neurons as a result of deafferentation, they implemented a growth rule that enabled the neurons to increase the number of lateral connections.
In our research, we measure the memory capacity of balanced spiking neural networks possessing capabilities of both fast synaptic and slow structural plasticity by calculating a signal to noise ratio . The memory capacity of a network of neurons is dependent on various parameters such as the magnitude of the recall stimulus, the size of the pattern relative to the size of the network, the learning rule that dictates inhibitory plasticity, and so on. In this work, as an initial step, we investigate the memory capacity of a non lesioned network containing spike-time dependent plastic inhibitory synapses similar to the network used by Vogels and collaborators. Random, possibly overlapping patterns are iteratively stored in the network as Hebbian assemblies. In order to measure their signal to noise ratio, the stored patterns are recalled by the activation of a randomly selected subset of their neurons. In general, during the recall of the stored patterns, we observe a gradual decrease in the signal to noise ratio as more and more patterns are stored in the network. This signifies an inverse relation between the mean signal to noise ratio and the total number of such patterns that were stored in the network. We are currently investigating the performance of our balanced networks during and after focal lesions and homoeostatic rewiring.
- Vogels T, Sprekeler H, Zenke F, Clopath C, Gerstner W: Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science. 2011, 334 (6062): 1569-1573.PubMedView ArticleGoogle Scholar
- Butz M, van Ooyen A: A simple rule for dendritic Spine and axonal bouton formation can account for cortical reorganization after focal retinal lesions. PLoS Comput Biol. 2013, 9 (10): e1003259-PubMedPubMed CentralView ArticleGoogle Scholar
- Butz M, van Ooyen A: Homeostatic structural plasticity - a key to neuronal network formation and repair. BMC Neuroscience. 2014, 15 (Suppl 1): P17-PubMed CentralView ArticleGoogle Scholar
- Keck T, Mrsic-Flogel TD, Afonso MV, Eysel UT, Bonhoeffer T, Hübener M: Massive restructuring of neuronal circuits during functional reorganization of adult visual cortex. Nature Neuroscience. 2008, 11 (10): 1162-1167.PubMedView ArticleGoogle Scholar
- Yamahachi H, Marik SA, McManus JN, Denk W, Gilbert CD: Rapid axonal sprouting and pruning accompany functional reorganization in primary visual cortex. Neuron. 2009, 64 (5): 719-729.PubMedPubMed CentralView ArticleGoogle Scholar
- Dayan P, Willshaw DJ: Optimising synaptic learning rules in linear associative memories. Biological Cybernetics. 1991, 65 (4): 253-265.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.