- Poster presentation
- Open Access
A unifying perspective on neuromodulatory effects on signal transmission and plasticity in D1-dominant MSN neurons
© Vogt and Hofmann; licensee BioMed Central Ltd. 2013
- Published: 8 July 2013
- Phasic Change
- Signal Transmission
- Learning Outcome
- Phenomenological Model
How could phasic variations in dopamine level affect the learning outcome of a spiking neural network? How may neuromodulation affect the network's instantaneous response to simultaneously arriving glutamatergic inputs? How may this depend on the brain regions involved?
In our spiking phenomenological model for signal transmission across the synapse and along the dendritic tree, we propose a new approach for the influence of dopamine-like neuromodulators on the ascribed aspects, which unifies diverging views on its role in (reinforcement) learning and (attentional) contrast.
We call into question the common practice of simulating dopaminergic influence on an STDP rule as a third factor, and instead show how an instantaneous effect of a dopamine-like neuromodulator on postsynaptic activity can also lead to reinforced learning outcomes.
As the phasic change of neuromodulator needs to be present during glutamatergic transmission in our model, we do not account for delayed reward as stated in the distal reward problem. Instead, we assume an involvement of hippocampus and cortical working memory for long delays of reward. However, as our transmission-based model does not interfere with the standard two-factor STDP rule, it may be freely combined with existing extensions to STDP if needed.
- Schultz W, Dayan P, Montague PR: A neural substrate of prediction and reward. Science. 1997, 275 (5306): 1593-10.1126/science.275.5306.1593.View ArticlePubMedGoogle Scholar
- Berridge KC, Robinson TE: What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain research Brain research reviews. 1998, 28 (3): 309-369. 10.1016/S0165-0173(98)00019-8.View ArticlePubMedGoogle Scholar
- Nicola SM, Hopf FW, Hjelmstad GO: Contrast enhancement: a physiological effect of striatal dopamine?. Cell and tissue research. 2004, 318 (1): 93-106. 10.1007/s00441-004-0929-z.View ArticlePubMedGoogle Scholar
- Thurley K, Senn W, Lüscher HR: Dopamine increases the gain of the input-output response of rat prefrontal pyramidal neurons. Journal of neurophysiology. 2008, 99 (6): 2985-2997. 10.1152/jn.01098.2007.View ArticlePubMedGoogle Scholar
- Kroener S, Chandler LJ, Phillips PEM, Seamans JK: Dopamine modulates persistent synaptic activity and enhances the signal-to-noise ratio in the prefrontal cortex. PloS One. 2009, 4 (8): 6507-10.1371/journal.pone.0006507.View ArticleGoogle Scholar
- Masquelier T, Guyonneau R, Thorpe SJ: Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains. PloS one. 2008, 3 (1): 1377-10.1371/journal.pone.0001377.View ArticleGoogle Scholar
- Shen W, Flajolet M, Greengard P, Surmeier DJ: Dichotomous dopaminergic control of striatal synaptic plasticity. Science. 2008, 321 (5890): 848-851. 10.1126/science.1160575.PubMed CentralView ArticlePubMedGoogle Scholar
- Morrison A, Diesmann M, Gerstner W: Phenomenological models of synaptic plasticity based on spike timing. Biological cybernetics. 2008, 98 (6): 459-478. 10.1007/s00422-008-0233-1.PubMed CentralView ArticlePubMedGoogle Scholar
- Izhikevich EM: Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex. 2007, 17 (10): 2443-2452.View ArticlePubMedGoogle Scholar
- Vogt SM, Hofmann UG: Neuromodulation of STDP through short-term changes in firing causality. Cognitive Neurodynamics. 2012, 6 (4): 353-366. 10.1007/s11571-012-9202-4.PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.