Improving pattern retrieval in an auto-associative neural network of spiking neurons
© Hunter et al; licensee BioMed Central Ltd. 2009
Published: 13 July 2009
Similarities between neural network models of associative memory and the mammalian hippocampus have been examined [1, 2]. Here we compare and contrast the recall dynamics and quality of a biologically based spiking network  which is comprised of 1000 biologically realistic Pinsky-Rinzel two-compartment model CA3 pyramidal cells  with the previously published results for the ANN associative memories [1, 2].
We study biologically plausible implementations of the Winners-Take-All approach to unit (neuron) thresholding during recall of previously stored patterns. The WTA approach simply chooses the required number of units with the highest dendritic sum to fire during pattern recall. Various mathematical transforms of the dendritic sum can compensate for partial network connectivity and noise due to pattern overlap . We investigate whether biologically plausible implementations of these transforms can be found in order to improve the performance of pattern recall in the spiking network. This includes the use of structured inhibition to account for partial connectivity, and nonlinear amplification of EPSPs in pyramidal cells to help disambiguate overlapping patterns.
Using these methods we found that the mean quality recall can be improved. The mean recall over all 200 stored patterns show a statistically significant improvement in both methods with a greater improvement measured when using the structured inhibition. An interesting result found in both methods was the increase in synchronous activity, where the number of iterations recorded over the simulation was increased. This could suggest that local inhibitory and cellular modification could play a role in further synchronization of cells during memory retrieval.
The network capacity is also tested by measuring the pattern stability during recall when an entire pattern is instantiated upon both an ANN model and the biological network. Applications of the similar WTA recall algorithms allows direct comparison of the network properties during recall. Preliminary results from a net consisting of 100 units and 1000 units suggest interesting network dynamics in the biological net. Over 1 iteration the artificial net performed better than the biological net containing 100 PCs. The biological network over literation containing 1000 PCs performed better than the artificial network. Over 5 iterations, both the 100 and 1000 PC configurations of the biological net showed distinctive improvements compared to the artificial nets. Suggesting the role of inhibition in the biological network plays a very important role in pattern retrieval.
This work was funded by an EPSRC project grant to B. Graham and S. Cobb.
- Graham B, Willshaw D: Improving recall from an associative memory. Bio Cybernetics. 1995, 72: 337-346.View ArticleGoogle Scholar
- Graham B, Willshaw D: Capacity and information efficiency of the associative net. Network. 1997, 8: 35-54.View ArticleGoogle Scholar
- Sommer FT, Wennekers T: Associative memory in networks of spiking neurons. Neural Networks. 2001, 14: 825-834.PubMedView ArticleGoogle Scholar
- Pinsky P, Rinzel J: Intrinsic and network rhythmogenesis in a reduced Traub model for CA3 neurons. J Comput Neuroscience. 1994, 1: 3960.View ArticleGoogle Scholar
- Hunter R, Cobb S, Graham BP: Improving associative memory in a network of spiking neurons. ICANN. 2008, 2: 636-645.Google Scholar
- Santhakumar V, Ildiko A, Soltesz I: Role of mossy fiber sprouting and mossy cell loss in hyperexcitability: A network model of the dentate gyrus incorporating cell types an axonal topography. J Neurophysiol. 2005, 93: 437-453.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd.