Inter- and intraobserver variability in motor mapping of the hotspot for the abductor policis brevis muscle
- Nico Sollmann†1,
- Theresa Hauck†1,
- Thomas Obermüller1,
- Alexander Hapfelmeier2,
- Bernhard Meyer1,
- Florian Ringel1 and
- Sandro M Krieg1Email author
© Sollmann et al.; licensee BioMed Central Ltd. 2013
Received: 1 May 2013
Accepted: 3 September 2013
Published: 5 September 2013
For accuracy in navigated transcranial magnetic stimulation (nTMS), determination of the hotspot location of small hand muscles is crucial because it is the basis for the resting motor threshold (RMT) and, therefore, its spatial resolution. We investigated intra- and interobserver differences of hotspot mapping to provide evidence for the reproducibility of this method.
Ten subjects underwent nTMS motor mapping of the hotspot for the abductor pollicis brevis muscle (APB) three times. The first two sessions were performed by the same examiner; the third mapping was performed by a different examiner. Distances between the first and second mappings (intraobserver variability) and between the second and third mappings (interobserver variability) were measured.
Intraobserver variability had a mean of 8.1 ± 3.3 mm (limits of agreement (LOA) 1.7 to 14.6 mm), whereas mean interobserver variability was 10.3 ± 3.3 mm (LOA 3.8 to 16.7 mm). Concerning RMT, CCC was 0.725 (95% CI: 0.276; 0.914). The mean variability in the same cortical depth was measured as 5.7 ± 3.3 mm (LOA −0.7 to 12.2 mm) for intraobserver and 9.2 ± 3.3 mm (LOA 2.7 to 15.8 mm) for interobserver examinations. When evaluating the RMT, CCC was 0.709 (95% CI: 0.244; 0.909).
Overall, intraobserver variability showed higher reliability than interobserver variability. Our findings show that we can achieve good reliability in hotspot determination, ranging within the calculated precision of the system.
KeywordsCortical mapping Transcranial magnetic stimulation Motor mapping Navigated brain stimulation Motor threshold Hand knob
In recent years, navigated transcranial magnetic stimulation (nTMS) has been increasingly competing with other diagnostic modalities in visualizing functional brain areas . Having started as an approach for determining cortical motor areas, this promising technique has developed into a multifunctional tool for various diagnostic and therapeutic issues. Although intraoperative direct cortical stimulation (DCS) is the gold standard for the mapping of brain functions, it is not able to provide exact information about the healthy human brain, mainly because of its invasiveness. One main benefit of nTMS is its non-invasive nature, which allows the implementation of this method in the preoperative setup . Additionally, a correlation of nTMS and DCS in motor mapping has already been reported [1, 3–5]. However, until now there have only been a few studies on the reproducibility of nTMS motor mapping and individual resting motor threshold (RMT), especially concerning intra- and interobserver investigations. Former studies showed comparable results in repeated mappings. However, these data is based on non-navigated TMS .
Finding the same spot for determination of the RMT seems crucial because the RMT determines spatial resolution of nTMS motor mapping. And despite various influencing factors which might impair the measurement, RMT should be determined at the same cortical spot. Even when this claim does not mirror reality. Knowledge about hotspot location stability in repeated nTMS investigations is essential in detecting the correct RMT. Inaccuracy in this step at the beginning of the mapping session causes imprecision in the whole procedure.
Moreover, besides preoperative nTMS motor mapping, recent data show that TMS also serves as a neurophysiological assessment of the functional status of the patient’s motor system especially for neurorehabilitation issues .
As the reliability of the hotspot location is crucial for the accuracy of nTMS examinations, this study provides data about intra- and interobserver variability in motor mapping of the hotspot for the abductor pollicis brevis muscle (APB).
Ten healthy subjects underwent nTMS motor mapping of the hotspot for the right APB on the left hemisphere. This examination was performed three times at three different days. The first and second mappings were conducted by the same investigator in order to evaluate intraobserver variability. Additionally, interobserver variability was determined by comparing the second mapping and a third mapping performed by a different examiner. Both investigators were blinded to previous results and their experience in nTMS was comparable. Moreover, both investigators had considerable experience in nTMS mapping prior to this study.
The volunteers suffered from no cerebral pathology and were all right-handed. Five subjects were male, five subjects were female. The median age was 24.2 years (range 22.7 to 30.3 years). No one was under any kind of medication.
The study was conducted with the consent of the local ethics committee of the Technical University of Munich (registration number: 2793/10) and in accordance with the Declaration of Helsinki. Written informed consent was obtained from all volunteers prior to navigational MRI.
All subjects underwent MR imaging prior to the first mapping. MRI was performed on a 3 Tesla MR scanner combined with an 8-channel phased array head coil (Achieva 3 T, Philips Medical Systems, The Netherlands B.V.). The scanning protocol consisted of a 3D gradient echo sequence (TR/TE 9/4 ms, 1 mm2 isovoxel covering the whole head, 6 min 58 s acquisition time) without intravenous contrast administration for anatomical co-registration. Using DICOM standards, the 3D dataset was then transferred to the nTMS system.
Navigated transcranial magnetic stimulation
At each mapping session, the subjects underwent the same procedure for mapping of the hotspot as described in earlier reports [3, 5]. In short, the used nTMS system (eXimia 4.3, Nexstim, Helsinki, Finland) includes a magnetic stimulator with a biphasic figure-of-eight TMS coil with a radius of 50 mm. The navigation device (Polaris Spectra, Waterloo, Ontario, Canada) orients individual 3D MR images to the patient’s head by infrared tracking using spheres coated with retro-reflective surface. The used nTMS system estimates the induced electric field strength with regard to the patient’s head shape and then visualizes this electric field strength on the cortical surface, which is reconstructed by the MRI dataset [8, 9]. While stimulating with nTMS, electromyography (EMG) (eXimia 4.3, Nexstim, Helsinki, Finland) is triggered by nTMS stimuli and monitored continuously. EMG was recorded over the skin of the APB by pregelled disposable Ag/AgCl electrodes (Neuroline 720, Ambu, Bad Nauheim, Germany) and the reference electrode was placed at the ipsilateral elbow above the tendon of the biceps muscle. The sampling rate was 3 kHz; resolution was 0.3 μV. Noise of the device was lower than 5 μV for peak-to-peak measurements. While applying stimulation over the left-hemispheric motor cortex, motor evoked potentials (MEP) of the right APB were measured by EMG. The subjects were told to focus on the EMG to relax their muscles. Thus, we achieved a highly comparable alertnes.
Median number of stimuli (range)
33 (15 to 57)
35 (17 to 56)
36.5 (19 to 45)
Median RMT (% Output) (range)
38.5% (26% to 47%)
38.0% (26% to 44%)
38.0% (24% to 44%)
Data export and measurement
The distribution of continuous data is summarized by mean ± standard deviation (SD) and presented by boxplots. Comparisons of intra- and interobserver distances are performed by paired-samples t-tests. The variability of the different mappings was evaluated and visualized by a Bland-Altman plot . When regarding the hotspot distances between the different measurements, not only mean ± SD but also limits of agreement (LOA) (= mean ± 1.96 × SD) were calculated which represent the 95% likely range for the difference between two measurements. Moreover, to calculate concordance of the RMT, Lin’s concordance correlation coefficient (CCC) as well as its 95% confidence interval (95% CI) was calculated. Concerning RMT, differences between groups were tested by the Kruskall-Wallis test for nonparametric one-way analysis of variance (ANOVA) followed by Dunn’s test as the post hoc test. All statistical tests were conducted in an explorative manner on a two-sided 5% significance level.
During the initial mapping, the median RMT for the left hemisphere was defined as 38.5% (range 26.0% to 47.0%) of the maximal output. The second mapping (i.e., first remapping) was conducted with a left-hemispheric RMT of 38.0% (range 26.0% to 44.0%) of the system’s output. During the third mapping (i.e., second remapping), the RMT for the left hemisphere was determined as 38.0% (range 24.0% to 44.0%) of the maximal output (Table 1).
Interobserver hotspot distances were defined as the distance between the second mapping (i.e., first remapping) and the third mapping (i.e., second remapping), which was performed by a different examiner, as mentioned above. Focusing on x-coordinates (medio-lateral direction), the hotspot distances were measured to be −3.3 ± 5.0 mm (LOA −13.1 to 6.5), whereas the distance between y-coordinates (cranio-caudal direction) was −3.2 ± 3.2 mm (LOA −9.6 to 3.1). Additionally, the distance between hotspots was measured to be 5.4 ± 6.1 mm (LOA −6.5 to 17.3) for the z-coordinate (anterior-posterior direction). For the interobserver comparison, the mean hotspot distance in the same peeling depth (combined x- and z-axis) was 9.2 ± 3.3 mm (LOA 2.7 to 15.8; Figures 2 and 3). The interobserver distance of all combined axes was 10.3 ± 3.3 mm (LOA 3.8 to 16.7; Figure 2). When evaluating the RMT, CCC was 0.709 (95% CI: 0.244; 0.909) (Figure 4).
Comparison of the measured intra- and interobserver distances
Table 1 shows the properties of the three mappings. In all categories, differences were observed to be not significant. Considering the intra- and interobserver distances between y-coordinates and the three dimensional distances (all axes), we were not able to show any significant differences (y-coordinates: p = 0.294, all axes: p = 0.156; Figure 2). In contrast, comparing the intra- and interobserver distances with regard to x- and z-coordinates and to the hotspot distances in the same peeling depth (combined x- and z-axes), we observed statistically significant large interobserver distances (x-coordinates: p = 0.015; z-coordinates: p = 0.023, combined x- and z-axes: p = 0.010; Figures 2 and 3).
RMT determination at the hotspot of small hand muscles is considered a measure for motor cortex excitability. Thus, variability of the hotspot plays an important role for nTMS, both in motor and in language mapping, because it determines the accuracy of nTMS investigations.
In this study, still considering the low sample size, intraobserver comparison showed a higher precision than interobserver investigations in motor mapping of the hotspot for the APB (Figures 2 and 3). This difference is statistically significant when comparing the measured distances of both samples with regard to x- and z-coordinates and to the hotspot distances in the same peeling depth. In contrast, considering variations in distances between y-coordinates and between all axes, we were not able to show statistically significant differences (Figure 2). This correlates well with the fact that the peeling depth is adjusted by varying the y-coordinates. It can be modified several millimeters without having a crucial effect on the mapping procedure; thus, its setting can vary within a small range (Figure 2). Yet, we have to keep in mind that the small sample size still minors the power of statistical tests and therefore judgment of our findings.
However, we have to question why interobserver variability is larger than intraobserver variability. Previous studies have shown that there are individual differences among humans concerning not only hotspot localization but also hotspot shapes . Unfortunately, we still do not know much about interindividual variations in measurement of hotspot size.
However, Pascual-Leone, Wassermann et al. (1995) found that the size of the motor areas in the brain for the hand muscles are able to enlarge significantly after only hours of intensive use. Thus, the timing can play an important role in plasticity investigations, especially when the enrolled subjects of our study are university students who have greater than average use of the right hand.
We also compared the RMTs of all three sessions. Previous studies have shown that the value of the individual motor threshold varies . In our findings, the maximum individual fluctuation was 9% of the total output. Nevertheless, on average, the determined RMTs were almost stable and there was only minimal variation from mapping to mapping (Table 1, Figure 4). As mentioned above, no subject was under any kind of medication. Moreover, special attention was paid on comparable alertness during all mappings.
There already exist several studies on mainly non-navigated TMS that deal with reliability in hotspot determination [6, 13–18]. Wolf et al. , for example, achieved a distance of 8.9 mm between two sessions with a range from 0 to 22.4 mm. They used the hotspot of the extensor digitorum communis muscle instead of the APB. Nevertheless, comparison among these studies is only possible to a certain extent because previous investigations were conducted using a different muscle, a different navigation system, or non-navigated TMS.
The most important error source in non-navigated TMS is inexact coil positioning because minor movements of the coil or modifications of the angle can cause significant deviations in field strength and stimulus location . With the development of nTMS, we are able to reduce this major error source, and respectable accuracy can be attained [8, 21]. Yet, the nTMS system is composed of several specific units, such as MRI-registration, infrared camera system, stimulation coil, induced E-field calculation, head shape, head tracker, etc., which all add minor inaccuracies to the calculated overall error of the used system. Thus, the accuracy of the system depends on the accuracy and the interaction of such principal factors. As Ruohonen and Karhu (2010) described in detail, the E-field computation model causes the highest inaccuracy (3.8 mm) in the system, followed by shifting of the head tracker (3.1 mm), and imperfect alignment between anatomical MR images and the individual’s head (2.5 mm) . The localization of the coil constitutes only 1.6 mm deviation.
In the end, the median overall error of the whole system was calculated to be 5.73 mm . The mean distance of all combined axes was 8.1 mm in our intraobserver investigations and 10.3 mm in our interobserver comparisons. Taking into account that the calculated system error impairs both measurements, the inaccuracy of the whole system can increase up to 11.46 mm (2 × 5.73 mm) in the three-dimensional space. Both the mean intra- and the interobserver distances were within this 11.46 mm value, which means, on the one hand, that the two compared hotspots might actually be located at exactly the same spot, although we measured a distance of several millimeters. On the other hand, the smallest determined distance of 3.0 mm could be much larger in reality.
In other words, our results are within the calculated error of the whole system, and reproducibility seems to be independent of the examiner, at least concerning the nTMS system used in this study. With regard to our findings, we can therefore state that the intraobserver and the interobserver hotspot distances show sufficient reliability within the system’s accuracy for neurosurgical applications.
NS and TH are medical student who are performing a considerable number of TMS studies. All other authors are strongly involved in the treatment of brain tumors including awake surgery, preoperative mapping, and intraoperative neuromonitoring in a specialized neurooncological center. BM is chairman and FR is vice chairman of the department.
Abductor pollicis brevis muscle
Concordance correlation coefficient
Direct cortical stimulation
Limits of agreement
Motor evoked potentials
Magnetic resonance imaging
Navigated transcranial magnetic stimulation
Resting motor threshold
- Tarapore PE, Tate MC, Findlay AM, Honma SM, Mizuiri D, Berger MS, Nagarajan SS: Preoperative multimodal motor mapping: a comparison of magneto encephalography imaging, navigated transcranial magnetic stimulation, and direct cortical stimulation. J Neurosurg. 2012, 117 (2): 354-362. 10.3171/2012.5.JNS112124.PubMed CentralView ArticlePubMed
- Picht T, Schulz J, Hanna M, Schmidt S, Suess O, Vajkoczy P: Assessment of the influence of navigated transcranial magnetic stimulation on surgical planning for tumors in or near the motor cortex. Neurosurgery. 2012, 70 (5): 1248-1256. 10.1227/NEU.0b013e318243881e. discussion 1256–1247View ArticlePubMed
- Krieg SM, Shiban E, Buchmann N, Gempt J, Foerschler A, Meyer B, Ringel F: Utility of presurgical navigated transcranial magnetic brain stimulation for the resection of tumors in eloquent motor areas. J Neurosurg. 2012, 116 (5): 994-1001. 10.3171/2011.12.JNS111524.View ArticlePubMed
- Picht T, Mularski S, Kuehn B, Vajkoczy P, Kombos T, Suess O: Navigated transcranial magnetic stimulation for preoperative functional diagnostics in brain tumor surgery. Neurosurg. 2009, 65 (6 Suppl): 93-98.
- Krieg SM, Shiban E, Buchmann N, Meyer B, Ringel F: Presurgical navigated transcranial magnetic brain stimulation for recurrent gliomas in motor eloquent areas. Clin Neurophysiol. 2013, 124 (3): 522-527. 10.1016/j.clinph.2012.08.011.View ArticlePubMed
- Uy J, Ridding MC, Miles TS: Stability of maps of human motor cortex made with transcranial magnetic stimulation. Brain Topogr. 2002, 14 (4): 293-297. 10.1023/A:1015752711146.View ArticlePubMed
- Picht T, Strack V, Schulz J, Zdunczyk A, Frey D, Schmidt S, Vajkoczy P: Assessing the functional status of the motor system in brain tumor patients using transcranial magnetic stimulation. Acta Neurochir (Wien). 2012, 154 (11): 2075-2081. 10.1007/s00701-012-1494-y.View Article
- Ilmoniemi RJ, Ruohonen J, Karhu J: Transcranial magnetic stimulation–a new tool for functional imaging of the brain. Crit Rev Biomed Eng. 1999, 27 (3–5): 241-284.PubMed
- Ruohonen J, Ilmoniemi RJ: Modeling of the stimulating field generation in TMS. Electroencephalogr Clin Neurophysiol Suppl. 1999, 51: 30-40.PubMed
- Yousry TA, Schmid UD, Alkadhi H, Schmidt D, Peraud A, Buettner A, Winkler P: Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. Brain J Neurol. 1997, 120 (Pt 1): 141-157.View Article
- Niskanen E, Julkunen P, Saisanen L, Vanninen R, Karjalainen P, Kononen M: Group-level variations in motor representation areas of thenar and anterior tibial muscles: navigated transcranial magnetic stimulation study. Hum Brain Mapp. 2010, 31 (8): 1272-1280.PubMed
- Hattemer K, Knake S, Reis J, Rochon J, Oertel WH, Rosenow F, Hamer HM: Excitability of the motor cortex during ovulatory and anovulatory cycles: a transcranial magnetic stimulation study. Clin Endocrinol. 2007, 66 (3): 387-393. 10.1111/j.1365-2265.2007.02744.x.View Article
- Carroll T, Riek S, Carson R: Reliability of the input–output properties of the cortico-spinal pathway obtained from transcranial magnetic and electrical stimulation. J Neurosci Methods. 2001, 112 (2): 193-202. 10.1016/S0165-0270(01)00468-X.View ArticlePubMed
- Malcolm MP, Triggs WJ, Light KE, Shechtman O, Khandekar G, Gonzalez Rothi LJ: Reliability of motor cortex transcranial magnetic stimulation in four muscle representations. Clin Neurophysiol. 2006, 117 (5): 1037-1046. 10.1016/j.clinph.2006.02.005.View ArticlePubMed
- Miranda PC, de Carvalho M, Conceicao I, Luis ML, Ducla-Soares E: A new method for reproducible coil positioning in transcranial magnetic stimulation mapping. Electroencephalogr Clin Neurophysiol. 1997, 105 (2): 116-123. 10.1016/S0924-980X(97)95720-9.View ArticlePubMed
- Mortifee PSH, Schulzer M, Eisen A: Reliability of transcranial magnetic stimulation for mapping the human motor cortex. Electroencephalogr Clin Neurophysiol. 1994, 93 (2): 131-137. 10.1016/0168-5597(94)90076-0.View ArticlePubMed
- Weiss C, Nettekoven C, Rehme AK, Neuschmelting V, Eisenbeis A, Goldbrunner R, Grefkes C: Mapping the hand, foot and face representations in the primary motor cortex - Retest reliability of neuronavigated TMS versus functional MRI. Neuroimage. 2012, 66C: 531-542.
- Forster MT, Senft C, Hattingen E, Lorei M, Seifert V, Szelenyi A: Motor cortex evaluation by nTMS after surgery of central region tumors: a feasibility study. Acta Neurochir (Wien). 2012, 154 (8): 1351-1359. 10.1007/s00701-012-1403-4.View ArticlePubMed
- Wolf SL, Butler AJ, Campana GI, Parris TA, Struys DM, Weinstein SR, Weiss P: Intra-subject reliability of parameters contributing to maps generated by transcranial magnetic stimulation in able-bodied adults. Clin Neurophysiol. 2004, 115 (8): 1740-1747. 10.1016/j.clinph.2004.02.027.View ArticlePubMed
- Conforto AB, Z’Graggen WJ, Kohl AS, Rosler KM, Kaelin-Lang A: Impact of coil position and electrophysiological monitoring on determination of motor thresholds to transcranial magnetic stimulation. Clin Neurophysiol. 2004, 115 (4): 812-819. 10.1016/j.clinph.2003.11.010.View ArticlePubMed
- Ruohonen J, Karhu J: Navigated transcranial magnetic stimulation. Neurophysiol Clin. 2010, 40 (1): 7-17. 10.1016/j.neucli.2010.01.006.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.