Volume 9 Supplement 1

Seventeenth Annual Computational Neuroscience Meeting: CNS*2008

Open Access

The effect of Hebbian plasticity on the attractors of a dynamical system

BMC Neuroscience20089(Suppl 1):P99


Published: 11 July 2008

A central problem in neuroscience is to bridge local synaptic plasticity and the global behavior of a system. It has been shown that Hebbian learning of connections in a feedforward network performs PCA on its inputs [1]. In recurrent Hopfield network with binary units, the Hebbian-learnt patterns form the attractors of the network [2]. Starting from a random recurrent network, Hebbian learning reduces system complexity from chaotic to fixed point [3].

In this paper, we investigate the effect of Hebbian plasticity on the attractors of a continuous dynamical system. In a Hopfield network with binary units, it can be shown that Hebbian learning of an attractor stabilizes it with deepened energy landscape and larger basin of attraction. We are interested in how these properties carry over to continuous dynamical systems.

Consider system of the form
x ˙ i = x i + f i ( g i j T i j x j ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGafmiEaGNbaiaadaWgaaWcbaGaemyAaKgabeaakiabg2da9iabgkHiTiabdIha4naaBaaaleaacqWGPbqAaeqaaOGaey4kaSIaemOzay2aaSbaaSqaaiabdMgaPbqabaGccqGGOaakcqWGNbWzdaWgaaWcbaGaemyAaKgabeaakmaaqafabaGaemivaq1aaSbaaSqaaiabdMgaPjabdQgaQbqabaGccqWG4baEdaWgaaWcbaGaemOAaOgabeaakiabcMcaPaWcbaGaemOAaOgabeqdcqGHris5aaaa@4740@

where x i is a real variable, and f i a nondecreasing nonlinear function with range [-1,1]. T is the synaptic matrix, which is assumed to have been learned from orthogonal binary ({1,-1}) patterns ξ μ , by the Hebbian rule: T = μ ξ μ ξ μ T MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemivaqLaeyypa0ZaaabuaeaacqaH+oaEdaahaaWcbeqaaiabeY7aTbaakiabe67a4naaCaaaleqabaGaeqiVd0MaemivaqfaaaqaaiabeY7aTbqab0GaeyyeIuoaaaa@3A61@ . Similar to the continuous Hopfield network [4], ξ μ are no longer attractors, unless the gains g i are big. Assume that the system settles down to an attractor X*, and undergoes Hebbian plasticity: T' = T + εX*X* T , where ε > 0 is the learning rate. We study how the attractor dynamics change following this plasticity.

We show that, in system (1) under certain general conditions, Hebbian plasticity makes the attractor move towards its corner of the hypercube. Linear stability analysis around the attractor shows that the maximum eigenvalue becomes more negative with learning, indicating a deeper landscape. This in a way improves the system's ability to retrieve the corresponding stored binary pattern, although the attractor itself is no longer stabilized the way it does in binary Hopfield networks.



Supported by EU project FP6-2005-015803 "Daisy", the Hertie Foundation and the Volkswagen Foundation.

Authors’ Affiliations

Frankfurt Institute for Advanced Studies (FIAS)


  1. Linsker R: Self-organization in a perceptual network. Computer. 1988, 21: 105-117. 10.1109/2.36.View ArticleGoogle Scholar
  2. Hopfield J: Neural networks and physical systems with emergent collective computational properties. Proceedings of the National Academy of Sciences of the USA. 1982, 79: 2554-2588. 10.1073/pnas.79.8.2554.PubMed CentralView ArticlePubMedGoogle Scholar
  3. Cessac B, Samuelides M: From neuron to neural networks dynamics. The European Physical Journal – Special Topics. 2007, 142 (1): 7-88. 10.1140/epjst/e2007-00058-2.View ArticleGoogle Scholar
  4. Hopfield J: Neurons with graded response have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences of the USA. 1984, 81: 3088-3092. 10.1073/pnas.81.10.3088.PubMed CentralView ArticlePubMedGoogle Scholar


© Zhu; licensee BioMed Central Ltd. 2008

This article is published under license to BioMed Central Ltd.