Skip to main content

Advertisement

General form of learning algorithms for neuromorphic hardware implementation

Article metrics

  • 1568 Accesses

  • 4 Citations

The DARPA Systems of Neuromorphic Adaptive Plastic Scalable Electronics (SyNAPSE) initiative aims to create a new generation of high-density, low-power consumption chips capable of replicating adaptive and intelligent behavior observed in animals. To ensure fast speed, low power consumption, and parallel learning in billions of synapses, the learning laws that govern the adaptive behavior must be implemented in hardware. Over the past decades, multitudes of learning laws have been proposed in the literature to explain how neural activity shapes synaptic connections to support adaptive behavior. In order to implement as many of these laws as possible on the hardware, some general and easily parameterized form of learning law has to be designed and implemented on the chip. Such a general form would allow instantiation of multiple learning laws through different parameterizations without rewiring the hardware.

From the perspectives of usefulness, stability, homeostatic properties, and spatial and temporal locality, this project analyzes four categories of existing learning rules:

  1. 1.

    Hebb rule derivatives with various methods for gating learning and decay;

  2. 2.

    Threshold rule variations including the covariance and BCM families;

  3. 3.

    Error-based learning rules; and

  4. 4.

    Reinforcement rules

For each individual category a general form that can be implemented in hardware was derived. Even more general forms that include multiple categories are further suggested.

Acknowledgements

AG, MV, HMA, BC, AY, JL and EM were partially supported by CELEST, an NSF Science of Learning Center [SBE-0354378]. AG, MV, HMA, BC, EM, and GS were partially supported by the SyNAPSE program of the Defense Advanced Research Project Agency [HR001109-03-0001]. BC was partially supported by the National Science Foundation’s IGERT Program [DGE-0221680].

Author information

Correspondence to Anatoli Gorchetchnikov.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Gorchetchnikov, A., Versace, M., Ames, H.M. et al. General form of learning algorithms for neuromorphic hardware implementation. BMC Neurosci 11, P91 (2010) doi:10.1186/1471-2202-11-S1-P91

Download citation

Keywords

  • Adaptive Behavior
  • Hardware Implementation
  • Learning Rule
  • Synaptic Connection
  • Multiple Category