Volume 12 Supplement 1

Twentieth Annual Computational Neuroscience Meeting: CNS*2011

Open Access

Prediction of spatiotemporal patterns of neural activity using a higher-order Markov representation of instantaneous pairwise maximum entropy model

BMC Neuroscience201112(Suppl 1):P245

DOI: 10.1186/1471-2202-12-S1-P245

Published: 18 July 2011

Maximum entropy (MaxEnt) models have been suggested to fit the spatiotemporal patterns of simultaneously observed neuronal spike trains. To build such models, the distribution, p x (X), needs to be determined, where X is a sequence of neural patterns formed from the vector X1,…,X n for n time samples, where X i is a sample of the spike train of a population at time i . Each neural pattern itself is a binary sequence, for which one represents a spike, and zero otherwise. MaxEnt models are constructed by matching the moments between neuronal constituents with the analogous empirical estimates from the distribution p x (X).

MaxEnt models that incorporate the first and second order interactions among neurons, also referred to as the instantaneous pairwise MaxEnt model or the Ising model, are expressed as

where the individual, h i , and coupling, J ij , terms are parameters associated with the first and second order interactions, respectively, and Z is a normalization factor to insure https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq1_HTML.gif . This model was shown to be effective in representing almost 90 percent of the information in small populations (less than 20 neurons) [1, 2]. The main disadvantage of this model, however, is that it ignores the temporal correlation that represents the effect of the history of spiking activity on the current population state. Extending the width of neural patterns has been proposed as a method to incorporate spiking history. It destroys, however, the information in precise spike timings [3].

To incorporate the history term without compromising information in spike times, a higher-order Markov model is constructed in which patterns from different time samples are added. An example first-order Markov representation is expressed as

where https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq2_HTML.gif and https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq3_HTML.gif are the individual, and https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq4_HTML.gif , https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq5_HTML.gif and https://static-content.springer.com/image/art%3A10.1186%2F1471-2202-12-S1-P245/MediaObjects/12868_2011_Article_2263_IEq6_HTML.gif are the coupling terms among the neuronal elements. This spatiotemporal model is more general than the representation introduced in Marre et al [4] to account for history terms , but at the expense of increasing the number of parameters.

We evaluated the performance of the extended MaxEnt model in predicting the activity pattern of cat V1 neurons in response to drifting grating stimuli. A population of 21 neurons was recorded with 5 tetrodes. We compared the prediction power of this model with the instantaneous pairwise MaxEnt model, as well as the independent model. We show that the iterative scaling algorithm makes the extended model converge faster compared to [4], and also reduces the Kullback-Leibler divergence between the estimated and true distributions by 20 percent. Taken together, these results suggest the importance of accounting for temporal correlations in predicting the spatiotemporal patterns.

Authors’ Affiliations

Department of Electrical and Computer Engineering, Michigan State University
Neuroscience Program, Michigan State University


  1. Schneidman E, Berry MJ, Segev R, Bialek W: Weak pairwise correlations imply strongly correlated network states in a neural population. Nature. 2006, 440: 1012-1007. 10.1038/nature04701.View ArticleGoogle Scholar
  2. Tang A, Jackson D, Hobbs J, Chen W, Smith JL, Patel H, Prieto A, Petrusca D, Grivich MI, Sher A: A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. Journal of Neuroscience. 2008, 28: 505-10.1523/JNEUROSCI.3359-07.2008.View ArticlePubMedGoogle Scholar
  3. Truccolo W, Hochberg LR, Donoghue JP: Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes. Nature neuroscience. 2009Google Scholar
  4. Marre O, Boustani El S, Fregnac Y, Destexhe A: Prediction of spatiotemporal patterns of neural activity from pairwise correlations. Physical review letters. 2009, 102: 138101-10.1103/PhysRevLett.102.138101.View ArticlePubMedGoogle Scholar


© Aghagolzadeh and Oweiss; licensee BioMed Central Ltd. 2011

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.