Neuromagnetic brain responses to words from semantic sub- and supercategories
© Assadollahi and Rockstroh; licensee BioMed Central Ltd. 2005
Received: 27 October 2004
Accepted: 31 August 2005
Published: 31 August 2005
We explored spatio-temporal patterns of cortical activity evoked by written words from super-ordinate and sub-ordinate semantic categories and hoped to find a differential cortical and/or temporal distribution of the brain response depending on the level of the categories. Twenty-three subjects saw 360 words belonging to six sub-ordinate categories (mammals, birds, fish, fruit, flowers, trees) within two super-ordinate categories (fauna, flora). Visually evoked magnetic fields were determined from whole-head (148-sensor) magnetoencephalography and analyzed in the source space (Minimum Norm Estimate).
Activity (MNE amplitudes) 100–150 ms after stimulus onset in the left occipito-temporal area distinguished super-ordinate categories, while later activity (300–550 ms) in the left temporal area distinguished the six sub-ordinate categories.
Our results document temporally and spatially distinct processing and representation of words according to their categorical information. If further studies can rule out possible confounds then our results may help constructing a theory about the internal structure of entries in the mental lexicon and its access.
The mental lexicon is usually considered to be a compilation of linguistic information, with each word having an entry. The precise structure of a lexical entry continues to be a topic of investigation and discussion. From a linguistic perspective, a lexical entry for a word should contain information about its pronunciation, its orthography, its syntactic properties, and its semantic information. In the present study, we explored the aspect of categories within semantic information. A sparrow for example, might belong to the category bird as well as to the category animal. How and where is such information encoded in the brain? Is the category information represented within one brain compartment or in a distributed fashion?
These questions are of course not only restricted to the mental lexicon but also apply to the field of visual object recognition, for example. Cognitive neuroscience has contributed to these questions by considering evidence on the representation of object categories in the brain (mainly derived from picture naming tasks): For visually presented exemplars of particular object categories the use of functional brain imaging disclosed activity in the ventral pathway of the visual system, with activity distinguishing different object categories (faces, animals, fruits, buildings, chairs, and man made tools) along the occipito-temporal pathway, which was thereupon labelled 'what-stream' (e.g., [1–9]).
Evidence from brain responses distinguishing between sub- and super-ordinate category information is still limited. For instance, Löw and colleagues  examined the spatial distribution of sources of neuromagnetic activity elicited by pictures of super- (e.g. animal, furniture etc) and sub-ordinate (e.g., deer, wolf; table, chair, etc.) object categories. Significantly higher similarity (correlation) of evoked magnetic responses within than across super-ordinate categories indicated macroscopically distinct representation of defined semantic categories. Activation of these representations was most prominent in the right parietal cortex around 200 ms and in the left parieto-temporal cortex around 400 ms after stimulus onset. This spatio-temporal sequence supports sequential perceptual dynamics of the categorization process, with initial activation of representation in the extrastriate areas of the right hemisphere followed by activity along the ventral processing stream primarily in the left temporal lobe.
This evidence served as the background for the present study, which aimed at clarifying the dynamics involved in the lexical access of words. Representation and activation of semantic categories were probed by analyzing spatio-temporal brain activity that was induced by written words. They a) were related to different super- and sub-ordinate categories; b) came from the natural domain (in order to rule out/control for possible effects of gross features of the man-made/nature-made difference); c) were of low to ultra-low frequency (exploiting evidence that low-frequent words induce marked event-related brain responses, ). Magnetic source imaging (MSI, the analysis of sources of activation from high-resolution magnetoencephalography) was used as an indication of cortical representation. In particular, we aimed at clarifying the following questions: a) whether visually presented words related to different super- and sub-ordinate natural categories would be represented in spatially separable areas along the occipital-to-temporal visual pathway, corresponding to the 'what stream' determined for visually presented object categories; b) whether distinct activity patterns primarily in the left hemisphere would indicate the representation of (additional) linguistic features for semantic categories activated by words; c) whether spatio-temporal brain responses distinguish super- and sub-ordinate categories as an indication of feature-directed category representation and access of lexical entries.
Results and discussion
As is also obvious from Figure 1, activity was prominent in the left hemisphere and negligible in the right hemisphere. Since effects of stimulus categories on activity patterns were statistically confirmed only for the left but not for the right hemisphere, the subsequent results refer to the left-hemisphere foci.
In sum, the activity near or at the left temporal pole differentiates between sub-categories. The sub-categories were selected to be semantic in nature. It is not clear whether the activity found resembles an N400 (a component generally reflecting the ease at which a word is integrated into a sentential context), which was also found to be elicited after single words . Also, source localisations of the N400 component do not give a clear picture where the N400 has its cortical origin.
For the left-anterior activity focus indicated in Figure 1, no significant effects of categories were found.
In sum, source analyses of neuromagnetic brain responses to words from different semantic categories, comprising super-ordinate (fauna, flora) and sub-ordinate categorization (mammals, birds, fish; fruit, flowers, trees) disclose specific spatio-temporal activation and a distinction in time and space for sub- versus super-ordinate category features: Whereas super-ordinate features induced different activation already around 100–150 ms after stimulus onset in left-occipital areas, the processing of sub-ordinate category features led to differential activation only later, between 300 and 550 ms, in left-temporal areas. This is, to our knowledge, the first evidence of spatio-temporal separation of category-feature processing in the brain.
"Hebbian-type cell assemblies" are described as distributed networks of neurons that are functionally connected by reciprocal dynamic connections and whose strength is modulated based on correlation learning [16, 17]. In Pulvermüller's framework of the mental lexicon (see  for an overview), the neuronal representation of a word may comprise neurons in the perisylvian cortex (where the acoustic word form is represented) and neurons in areas that process information about object features or associated actions. For nouns denominating objects these features comprise visual associations and, thus, the neuronal network activated by the noun will comprise neurons in the visual association areas in the occipital and inferior temporal lobe. During language acquisition, representations of objects are related to auditory or visual word forms. A cell assembly is established whenever a concept is activated repeatedly and simultaneously with the word form. This cell assembly will then comprise features that reflect parts of its word form representation and parts of the auditory or visual representation of the object the word refers to (the so-called referential information). From this point of view it makes sense that semantic features of object representations are also shared by the corresponding entries in the mental lexicon. Thus, the same sub-assemblies (reflecting a certain feature) are activated either by the word or by the object itself.
Pulvermüller's work also relates to the research field of the ventral "what-stream". Ishai  pointed out that the topological arrangement of visual features in the ventral "what"-stream remains to be clarified. If, as Pulvermüller argues, category-features activated by words are part of category-features activated by corresponding objects, then the present results contribute to this clarification, in that features related to sub-ordinate concepts are processed in areas more anterior to features related to super-ordinate concepts. Gauthier and colleagues  pointed out that in visual object recognition the super-ordinate-level (e.g. 'bird'), at which familiar objects are first recognized, was distinguished from more sub-ordinate levels (e.g. 'sparrow'), which required additional perceptual processing. This additional processing related to the sub-ordinate level representation was associated with activation in the fusiform and inferior temporal gyri and the temporal poles. This is in line with the more anterior focus of activity distinguishing sub-ordinate categories in the present study.
In the present study, it is conceivable that the categories fauna and flora activated features related to the visual representations of the respective objects. These features would be part of the representations of the physical, visually perceivable objects and as such part of the ventral "what"-stream of the left occipito-temporal cortex. There are several studies that showed early activation due to referential semantic information (e.g. [20–23]).
While these considerations are supported by the present results of category-specific activity patterns along the left occipito-temporal axis, they should be validated by a direct comparison of cortical activity evoked by pictures and their corresponding words. Chao and colleagues  report an fMRI study, where in fact there were similar activations for pictures and their corresponding names.
Why should the representations of sub- and supercategory features be processed at different sites in the brain? There is ample evidence that during the individual development of the brain, maximum neural plasticity starts at primary sensory (e.g. occipital) and motor sites and over time progresses towards secondary areas, parietal areas and finally towards frontal areas [24–28]. Using computer simulations, Shrager and Johnson  showed that simple representations of input data can be acquired in early stages of development (i.e. plasticity at primary sites) whereas more abstract representations can only be acquired in sites that had high plasticity later on (i.e. more anterior sites). These sites would use the information from the lower level representations together with the input to represent more abstract and/or invariant aspects of the stimulus. In the present case, this would mean that gross categories can be represented early on (in more primary, posterior sites) whereas more fine grained sub-representations will only be acquired later on (in more anterior sites).
We can only speculate how the amplitude difference in the present study relates to different categories or their features. Generally, there are two reasons for a stronger amplitude in the MEG. Either there are slight topographic differences or the size of the neuronal network activated varies over conditions. Cortical sources may be located on a part of a gyrus where the tangential part of the magnetic field is more or less prevalent than in a different condition. The magnetometers used in our 4D Neuroimaging system only capture tangential fields and thus a stronger component in the radial field would mean a reduction in the field strength measured. Thus, the amplitude difference may arise from a slight topographic shift. The other possible answer is that different features have different complexities in their representation. This may translate in different sizes of neuronal networks representing them. The activation of these networks will lead to greater amplitudes for larger networks. Another reason for different network sizes may be the relation of the word to other words. If all words are represented in networks, then these networks may have overlapping parts to reflect the relatedness of words. We tried to capture the associations that subjects had after reading our stimuli and found no systematic variation in the number of associations over categories. Thus, if networks of words (i.e. networks of networks) lead to different amplitudes due to a different degree of connectedness, then this is not a good explanation for the amplitude differences found in the present study. We therefore favour the interpretation of slightly different topographies resulting in different amplitudes.
The present study not only revealed that category related information is distributed spatially over the cortex, but it is also activated over time. The temporal sequence of cortical activation distinguished the processing super-ordinate (earlier) and sub-ordinate features (later). Considering the results of Gauthier and colleagues , we may conclude that features of lexical entries are hierarchically processed, with steps of feature analyses (super-ordinate first) spreading across hundreds of ms.
The present results may help to speculate over the inner structure of entries in the mental lexicon: Super- and sub-ordinate category features are parts of a word's representation; they activate distinct cortical areas in the left occipital-temporal axis at distinct points in time. Lexical entries may thus be understood as structure of features, represented in distributed networks that are activated by words in a sequential, cascaded way.
Twenty-three healthy, right-handed, native German speaking student subjects (12 m, 11f, mean age: 26) volunteers with normal or corrected-to-normal vision were paid (15€ for the two-hour session) for participation in the study.
Materials & procedure
Stimuli comprised 360 words related to the two super-ordinate categories (labelled 'fauna' and 'flora') and 6 sub-ordinate categories (fauna: mammals, birds, fish; flora: fruit, flowers, trees). For each sub-ordinate category, 60 stimuli were selected from the CELEX-database  for low-frequency (mean frequency was seven per million) and comparable length (8 letters). Since CELEX did not provide enough low frequent nature-made object names meeting these criteria (match for length, frequency < 10), 10 words with ultra-low frequency were added from other sources to each sub-category. We wanted to have as many stimuli as possible to have a broad base of individual concepts sharing their sub- and supercategory features. A better match for other word-level features such as bigram-letter-frequency etc would have further reduced the number of stimuli per category and would thus have reduced the representativeness of the study. The 360 words were assigned to 2 runs, each of 6 series of 30 stimuli (per sub-ordinate category). Within each series the 30 stimuli were presented in pseudo-random order.
Using a computerized test, we presented all 360 stimuli to 48 subjects (30 randomly selected items per subject; subjects did not take part in the MEG study) and asked them to write up their associations. Subjects had 60 seconds time to type in their association for each stimulus. The procedure resulted in four (= 360/48) sets of associations per stimulus, 240 (= 60 × 4) sets of associations per sub-ordinate category and 720 (= 240 × 3) sets of associations per super-ordinate category. We investigated the number of associations per word (i.e. how many associations were made on the average for this particular word) using a computer program and were surprised that this number was surprisingly similar for the super-ordinate categories (fauna: mean = 7.217, SD = 7.463; flora: mean = 7.206, SD = 7.414) as well as for the sub-ordinate categories (birds: mean = 7.289, SD = 7.499; mammals: mean = 7.347, SD = 7.582 ; fish: mean = 7.016, SD = 7.308; fruit: mean = 8.0, SD = 8.162; flowers: mean = 6.950, SD = 7.250; trees: mean = 7.206, SD = 7.414). Also, there were no differences between words that appear in the CELEX database and words that do not.
Stimuli were presented in white upper case letters (maximum word size 9 × 3 cm) on a black background at a distance of 1.4 m using an LCD-projector situated outside the MEG chamber. Presentation time was 250 ms per word with inter-stimulus intervals varying between 1200 and 2000 ms and an average of 1600 ms.
Subjects were instructed to fixate a cross which was projected on the screen during stimulus-free intervals, to read each word and to respond by button press only to (rare) nouns depicting artificial objects. These 36 stimuli were interspersed with 10% probability in order to ensure sustained attention and processing involving/activating the mental lexicon. (Responses to these filler items were not analysed.)
Data collection and analyses
Neuromagnetic signals were recorded continuously with a 148 channel whole head magnetometer (Magnes 2500 WH, 4D NeuroImaging Inc., San Diego) using a 0.1–100 Hz band-pass filter and sampled at a rate of 508 Hz. Additionally, vertical and horizontal EOG (electro-oculogram) were recorded for artifact control. Written informed consent was obtained from subjects prior to each MEG-session and the study was approved by the ethics committee of the University of Konstanz.
After external global noise subtraction continuous MEG and exclusion of artifact-contaminated epochs by visual inspection (EOG level > 100 μV, an MEG level > 5 pT, button press-induced artifacts), data were split into epochs of 900 ms length (including 100 ms pre-stimulus). This resulted on average in 50.2 MEG-traces per sub-category, subject and run (= 100.4 MEG-traces in sum per sub-category and subject). For every subject and for each of the six sub-ordinate categories, evoked magnetic fields (EMFs) were determined relative to a baseline of 100 ms pre-stimulus onset. For these average EMFs, cortical sources were determined using the minimum norm estimate (MNE, [31–33]), an objective inverse method to reconstruct the topography of the primary current underlying a magnetic field distribution (). Cortical activity was approximated in a three-dimensional spherical source space of radius 10 cm fitted individually to the head-shape of the subjects (4-D Neuroimaging software). On this sphere 197 equidistant dipoles for the estimation of source activity were assumed. The source estimations (MNE) of the two runs per subcategory were averaged.
MNE amplitudes (in nAm) were averaged for 50 ms-segments across the 600-ms interval after stimulus onset and plotted separately for the two super- and six sub-ordinate categories, respectively. Since topographies for all six sub-categories were similar, time intervals and areas of interest for further analyses were determined for the average across all sub-categories. As apparent from Figure 1 foci of activity, that is, topographic peaks of MNE amplitudes, were obvious for three distinct areas in the left hemisphere. For these areas, the MNE amplitudes of seven dipoles were averaged for statistical analyses of stimulus effects. For each of the three areas (left-occipital, left-temporal and left-anterior), effects of categories on MNE-amplitudes were verified by two-way repeated measures Analyses of Variance comparing the three sub-ordinate categories each (as within-subject factor SUB-ORDINATE) within the two super-ordinate categories (as within-subject factor SUPER-ORDINATE) for successive 50-ms time intervals. Stars in figure 2 resemble significant main effects whereas stars in figure 3 resemble significant interactions. Newman-Keuls tests served for post-hoc explanation of interactions.
Research was supported by the DFG (German Research Community; SFB 471).
- Martin A, Wiggs CL, Ungerleider LG, Haxby JV: Neural correlates of category-specific knowledge. Nature. 1996, 379: 649-652. 10.1038/379649a0.View ArticlePubMedGoogle Scholar
- Schendan HE, Ganis G, Kutas M: Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. Psychophysiology. 1998, 35: 240-251. 10.1017/S004857729897010X.View ArticlePubMedGoogle Scholar
- Aguirre GK, Zarahn E, D'Esposito M: An area within human ventral cortex sensitive to 'building' stimuli: evidence and implications. Neuron. 1998, 21: 373-383. 10.1016/S0896-6273(00)80546-2.View ArticlePubMedGoogle Scholar
- Gerlach C, Law I, Gade A, Paulson OB: Perceptual differentiation and category effects in normal object recognition. Brain. 1999, 122: 2159-2170. 10.1093/brain/122.11.2159.View ArticlePubMedGoogle Scholar
- Chao LL, Haxby JV, Martin A: Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat Neurosci. 1999, 2: 913-919. 10.1038/13217.View ArticlePubMedGoogle Scholar
- Ishai A, Ungerleider LG, Martin A, Schouten HL, Haxby JV: Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci U S A. 1999, 96: 9379-9384. 10.1073/pnas.96.16.9379.PubMed CentralView ArticlePubMedGoogle Scholar
- Moore CJ, Price CJ: A functional neuroimaging study of the variables that generate category-specific object processing differences. Brain. 1999, 122: 943-962. 10.1093/brain/122.5.943.View ArticlePubMedGoogle Scholar
- Allison T, Puce A, Spencer DD, McCarthy G: Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb Cortex. 1999, 9: 415-430. 10.1093/cercor/9.5.415.View ArticlePubMedGoogle Scholar
- Kanwisher N: Domain specificity in face perception. Nat Neurosci. 2000, 3: 759-763. 10.1038/77664.View ArticlePubMedGoogle Scholar
- Löw A, Elbert T, Bentin S, Silberman Y, Gomolla A, Cohen R, Rockstroh B: Semantic categories reflected in macroscopically distinct human brain activities. Psychol Sci. 2003, 14: 367-372. 10.1111/1467-9280.24451.View ArticlePubMedGoogle Scholar
- Rugg MD: Event-related brain potentials dissociate repetition effects of high- and low-frequency words. Memory & Cognition. 1990, 18: 367-379.View ArticleGoogle Scholar
- Tarkiainen A, Helenius P, Hansen PC, Cornelissen PL, Salmelin R: Dynamics of letter string perception in the human occipitotemporal cortex. Brain. 1999, 122: 2119-2132. 10.1093/brain/122.11.2119.View ArticlePubMedGoogle Scholar
- Cohen L, Lehéricy S, Chochon F, Lemer C, Rivaud S, Dehaene S: Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. Brain. 2002, 125 (5): 1054-1069. 10.1093/brain/awf094.View ArticlePubMedGoogle Scholar
- Assadollahi R, Pulvermuller F: Early influences of word length and frequency: a group study using MEG. Neuroreport. 2003, 14 (8): 1183-1187. 10.1097/00001756-200306110-00016.View ArticlePubMedGoogle Scholar
- Bentin S, McCarthy G, Wood CC: Event-related potential, lexical decision and semantic processing. Electroencephalogr Clin Neurophysiol. 1985, 60: 342-355.View ArticleGoogle Scholar
- Pulvermüller F: Words in the brain's language. Behav Brain Sci. 1999, 22: 253-336. 10.1017/S0140525X9900182X.View ArticlePubMedGoogle Scholar
- Varela FJ, Lachaux JP, Rodriguez E, Martinerie J: The Brain Web: Phase Synchronisation and Large-Scale Integration. Nat Rev. 2001, 2 (April): 229-239. 10.1038/35067550.View ArticleGoogle Scholar
- Ishai A: On Representation and Reproducibility. J Cogn Neurosci. 2003, 15 (7): 946-947. 10.1162/089892903770007335.View ArticlePubMedGoogle Scholar
- Gauthier I, Anderson AW, Tarr MJ, Skudlarski P, Gore JC: Levels of categorization in visual object studied with functional MRI. Curr Biol. 1997, 7: 645-651. 10.1016/S0960-9822(06)00291-0.View ArticlePubMedGoogle Scholar
- Marslen-Wilson WD, Tyler LK: The temporal structure of spoken language understanding. Cognition. 1980, 8: 1-71. 10.1016/0010-0277(80)90015-3.View ArticlePubMedGoogle Scholar
- Skrandies W: Evoked potential correlates of semantic meaning : a brain mapping study. Brain Res Cogn Brain Res. 1998, 6: 173-183. 10.1016/S0926-6410(97)00033-5.View ArticlePubMedGoogle Scholar
- Perani D, Cappa SF, Schnur T, Tettamanti M, Collina S, Rosa M, Fazio F: The neural correlates of verb and noun processing: a PET study. Brain. 1999, 122 (12): 2337-2344. 10.1093/brain/122.12.2337.View ArticlePubMedGoogle Scholar
- Hauk O, Pulvermüller F: Neurophysiological Distinction of Action Words in the Fronto-Central Cortex. Hum Brain Mapp. 2004, 21: 191-201. 10.1002/hbm.10157.View ArticlePubMedGoogle Scholar
- Pandya DN, Yeterian EH: Architecture and connections of cerebral cortex: implications for brain evolution and function. The Neurobiology of higher cognitive function. Edited by: Scheibel AB, Wechsler AF. 1990, New York: Guilford Press, 53-84.Google Scholar
- Thatcher RW: Cyclic cortical reorganization during early childhood. Brain Cogn. 1992, 20: 24-50. 10.1016/0278-2626(92)90060-Y.View ArticlePubMedGoogle Scholar
- Chugani HT, Phelps ME, Mazziotta JC: Positron emission tomography study of human brain functional development. Ann Neurol. 1987, 22: 487-497. 10.1002/ana.410220408.View ArticlePubMedGoogle Scholar
- Hanverth RS, Smith ELI, Duncan GC, Crawford MLI, von Noorden GK: Multiple sensitive periods in the development of the primate visual system. Science. 1986, 232: 235-238.View ArticleGoogle Scholar
- Shrager J, Johnson ME: Dynamic plasticity influences the emergence of function in a simple cortical array. Neur Netw. 1996, 9 (7): 1119-1129. 10.1016/0893-6080(96)00033-0.View ArticleGoogle Scholar
- Baayan H, Piepenbrock R, van Rijn H: The CELEX lexical database (CD-Rom). Linguistic Data Consortium. 1993, University of Pennsylvania PAGoogle Scholar
- Hämäläinen MS, Hari R, Ilmoniemi RJ, Knuutila J, Lounasmaa OV: Magnetoencephalography – theory, instrumentation, and applications to noninvasive studies of the working human brain. Reviews of Modern Physics. 1993, 65: 413-497. 10.1103/RevModPhys.65.413.View ArticleGoogle Scholar
- Hämäläinen MS, Ilmoniemi RJ: Interpreting magnetic fields of the brain: minimum norm estimates. Med Biol Eng Comput. 1994, 32: 35-42.View ArticlePubMedGoogle Scholar
- Hauk O, Berg P, Wienbruch C, Rockstroh B, Elbert T: Recent advances in biomagnetism. Edited by: Yoshimoto T, Kotani M, Kuriki S, Karibe H, Nakasato N. 1999, Sendai: Tohoku University Press, 213-216.Google Scholar
- Grave de Peralta Menendez R, Hauk O, Gonzalez Andino S, Vogt H, Michel C: Linear inverse solutions with optimal resolution kernels applied to the electromagnetic tomography. Hum Brain Mapp. 1997, 5 (6): 454-467. 10.1002/(SICI)1097-0193(1997)5:6<454::AID-HBM6>3.0.CO;2-2.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.