Identification of striatal cell assemblies suitable for reinforcement learning
BMC Neuroscience volume 12, Article number: P228 (2011)
Both in vivo  and in vitro  experimental data suggest that medium spiny neurons in striatum participate in the formation of sequentially firing cell assemblies, at a timescale relevant for the presumed involvement of basal ganglia in reinforcement learning. Computational models argue that such cell assemblies are a feature of a minimal network architecture of the striatum . This suggests that cell assemblies can be a potential candidate for representation of the 'system states' in the framework of reinforcement learning.
Spike patterns associated with cells assemblies can be identified by clustering the spectrum of zero-lag cross-correlation between all pairs of neurons in a network . Other methods based on the dimensionality reduction of the similarity matrix of the spike trains have also been used [2, 4].
Here we investigate how the identification of cell assemblies is dependent on the methodology chosen, and to what extent the statistical properties of the cell assemblies make them suitable for representation of system states in the striatum during reinforcement learning.
Miller BR, Walker AG, Shah AS, Barton SJ, Rebec GV: Disregulated information processing by medium spiny neurons in striatum of freely behaving mouse models of Huntington's disease. J Neurophysiol. 2008, 100: 2205-2216. 10.1152/jn.90606.2008.
Carrillo-Reid L, Tecuapetla F, Tapia D, Hernández-Cruz A, Galarraga E, Drucker-Colin R, Bargas J: Encoding network states by striatal cell assemblies. J Neurophysiol. 2008, 99: 1435-1450. 10.1152/jn.01131.2007.
Ponzi A, Wickens J: Sequentially switching cell assemblies in random inhibitory networks of spiking neurons in the striatum. J Neurosci. 2010, 30 (17): 5894-5911. 10.1523/JNEUROSCI.5540-09.2010.
Sasaki T, Matsuki N, Ikegaya Y: Metastability of active CA3 networks. J Neurosci. 2007, 27 (3): 517-528. 10.1523/JNEUROSCI.4514-06.2007.
Partially funded by the German Federal Ministry of Education and Research (BMBF 01GQ0420 to BCCN Freiburg, BMBF GW0542 Cognition and BMBF 01GW0730 Impulse Control), EU Grant 269921 (BrainScaleS), Helmholtz Alliance on Systems Biology (Germany), Neurex, the Junior Professor Program of Baden-Württemberg and the Erasmus Mundus Joint Doctoral programme EuroSPIN.
About this article
Cite this article
Toledo-Suárez, C., Yim, M.Y., Kumar, A. et al. Identification of striatal cell assemblies suitable for reinforcement learning. BMC Neurosci 12 (Suppl 1), P228 (2011). https://doi.org/10.1186/1471-2202-12-S1-P228