A unifying perspective on neuromodulatory effects on signal transmission and plasticity in D1-dominant MSN neurons
BMC Neuroscience volume 14, Article number: P172 (2013)
How could phasic variations in dopamine level affect the learning outcome of a spiking neural network? How may neuromodulation affect the network's instantaneous response to simultaneously arriving glutamatergic inputs? How may this depend on the brain regions involved?
In our spiking phenomenological model for signal transmission across the synapse and along the dendritic tree, we propose a new approach for the influence of dopamine-like neuromodulators on the ascribed aspects, which unifies diverging views on its role in (reinforcement) learning and (attentional) contrast.
We call into question the common practice of simulating dopaminergic influence on an STDP rule as a third factor, and instead show how an instantaneous effect of a dopamine-like neuromodulator on postsynaptic activity can also lead to reinforced learning outcomes.
As the phasic change of neuromodulator needs to be present during glutamatergic transmission in our model, we do not account for delayed reward as stated in the distal reward problem. Instead, we assume an involvement of hippocampus and cortical working memory for long delays of reward. However, as our transmission-based model does not interfere with the standard two-factor STDP rule, it may be freely combined with existing extensions to STDP if needed.
Schultz W, Dayan P, Montague PR: A neural substrate of prediction and reward. Science. 1997, 275 (5306): 1593-10.1126/science.275.5306.1593.
Berridge KC, Robinson TE: What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain research Brain research reviews. 1998, 28 (3): 309-369. 10.1016/S0165-0173(98)00019-8.
Nicola SM, Hopf FW, Hjelmstad GO: Contrast enhancement: a physiological effect of striatal dopamine?. Cell and tissue research. 2004, 318 (1): 93-106. 10.1007/s00441-004-0929-z.
Thurley K, Senn W, Lüscher HR: Dopamine increases the gain of the input-output response of rat prefrontal pyramidal neurons. Journal of neurophysiology. 2008, 99 (6): 2985-2997. 10.1152/jn.01098.2007.
Kroener S, Chandler LJ, Phillips PEM, Seamans JK: Dopamine modulates persistent synaptic activity and enhances the signal-to-noise ratio in the prefrontal cortex. PloS One. 2009, 4 (8): 6507-10.1371/journal.pone.0006507.
Masquelier T, Guyonneau R, Thorpe SJ: Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains. PloS one. 2008, 3 (1): 1377-10.1371/journal.pone.0001377.
Shen W, Flajolet M, Greengard P, Surmeier DJ: Dichotomous dopaminergic control of striatal synaptic plasticity. Science. 2008, 321 (5890): 848-851. 10.1126/science.1160575.
Morrison A, Diesmann M, Gerstner W: Phenomenological models of synaptic plasticity based on spike timing. Biological cybernetics. 2008, 98 (6): 459-478. 10.1007/s00422-008-0233-1.
Izhikevich EM: Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral cortex. 2007, 17 (10): 2443-2452.
Vogt SM, Hofmann UG: Neuromodulation of STDP through short-term changes in firing causality. Cognitive Neurodynamics. 2012, 6 (4): 353-366. 10.1007/s11571-012-9202-4.
About this article
Cite this article
Vogt, S.M., Hofmann, U.G. A unifying perspective on neuromodulatory effects on signal transmission and plasticity in D1-dominant MSN neurons. BMC Neurosci 14 (Suppl 1), P172 (2013). https://doi.org/10.1186/1471-2202-14-S1-P172