Decoding of naturalistic textures from spike patterns of neuromorphic artificial mechanoreceptors
© Mazzoni et al. 2015
Published: 18 December 2015
Significant advances were recently achieved in the bidirectional control of upper limb neuroprostheses , however implementing a realistic tactile feedback on artificial hands is still an open challenge . We target this ambition with a neuromorphic approach. Towards this direction we integrated MEMS tactile sensors with a realistic spatial arrangement on the distal phalanx of artificial fingers  and we converted the sensor readouts into spike trains mimicking the neural firing properties of glabrous skin mechanoreceptors . The neuromorphic approach presents several advantages , among which the most relevant for neuroprosthetics is that a sufficiently realistic tactile feedback is expected to reduce drastically the time the brain needs to adapt to the prosthesis and to each single new task, leading to enhanced quality of life of the subjects.
Since the long term goal is to implement a hardware version of the neuromorphic neurons, we modeled the mechanoreceptors as Izhikevich neurons, a model which at the same time is computationally lean and takes into account the effects of firing rate adaptation that are particularly relevant in mechanoreceptors. Parameters were tuned so to achieve a match with Slowly Adapting (SA) mechanoreceptors dynamics in primates . The output of each tactile sensor was normalized and injected as an excitatory input current into a single neuron model . To reproduce the features of Fast Adapting (FA) mechanoreceptors responsible for edge detection , we injected in a second set of neuron models the smoothed derivative of the pressure sensors outputs.
The fingertip was then repeatedly presented with ten different daily-life textures such as textiles, polymeric tissues, glass or paper. FA spike trains were used to identify onset and offset of contact between fingertip and stimuli, whereas SA spike trains were used to decode the stimulus presented. We applied two decoding procedures: one based on the combination of firing rate and inter-spike interval Fano factor, and the other one based on Victor-Purpura distance . Error rate was close to 20% in the first case and to 5% in the second, reflecting the relevance for decoding of the fine temporal structure of the neuromorphic sensor outputs. Finally, we introduced a normalization in the cost of the Victor-Purpura spike train metrics thanks to which the above level of correct classification was maintained even if sensing conditions varied across trials. These results support a possible future evaluation of the biomimetic fingertip endowed with neuromorphic artificial mechanoreceptors in clinical trials with human subjects.
This work was supported by the EU Grant FP7-FET 611687 NEBIAS project, by the EU Grant FP7-NMP 228844 NANOBIOTOUCH project, by the Italian PRIN HandBot project, and by Scuola Superiore Sant'Anna.
- Raspopovic S, Capogrosso M, Petrini FM, Bonizzato M, Rigosa J, Di Pino G, et al: Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses. Science Translational Medicine. 2014, 6 (222): 222ra219-View ArticleGoogle Scholar
- Kwok R: Neuroprosthetics: once more, with feeling. Nature. 2013, 497 (7448): 176-177.PubMedView ArticleGoogle Scholar
- Oddo CM, Controzzi M, Beccai L, Cipriani C, Carrozza MC: Roughness Encoding for Discrimination of Surfaces in Artificial Active-Touch. IEEE Transactions on Robotics. 2011, 27 (3): 522-533.View ArticleGoogle Scholar
- Johansson RS, Flanagan JR: Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat Rev Neurosci. 2009, 10 (5): 345-59.PubMedView ArticleGoogle Scholar
- Service RF: Minds of their own. Science. 2014, 346 (6206): 182-183.PubMedView ArticleGoogle Scholar
- Izhikevich EM: Simple model of spiking neurons. IEEE Transactions on Neural Networks. 2003, 14 (6): 1569-1572.PubMedView ArticleGoogle Scholar
- Spigler G, Oddo CM, Carrozza MC: Soft-neuromorphic artificial touch for applications in neuro-robotics. 2012 4th Ieee Ras & Embs International Conference on Biomedical Robotics and Biomechatronics (Biorob). 2012, 1913-1918.View ArticleGoogle Scholar
- Victor JD, Purpura KP: Nature and precision of temporal coding in visual cortex: A metric-space analysis. Journal of Neurophysiology. 1996, 76 (2): 1310-1326.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.