Towards guiding principles in workflow design to facilitate collaborative projects involving massively parallel electrophysiological data
© Denker et al; licensee BioMed Central Ltd. 2011
Published: 18 July 2011
The recent years have seen a rapid increase of interest in simultaneously analyzing the activity recorded from large numbers of channels in order to investigate the role of concerted neural activity in brain function. These efforts have led to advances in data analysis methods  that exploit the parallel properties of such data sets . However, an often neglected aspect is that massively parallel data streams place new demands on handling their complexity during all stages of the project : from the initial recording, throughout the analysis process, to the final publication. Three factors contribute these new demands: First, the sheer quantity of data complicates the organization of data sources, and the resulting automatization of analysis steps renders the validation of interim and final results difficult. Second, modern analysis methods often require intricate, multi-layered implementations, leading to sophisticated analysis toolchains . Third, a growing number of projects needs to be carried out in teams, within a laboratory or in collaborative efforts, requiring transparent workflows that guarantee smooth interaction. Taken together, the increase in complexity calls for a reevaluation of the ad-hoc traditional approaches to such projects. Can we derive general guiding principles that may be adopted for designs of efficient workflows? How could these improve our confidence in handling the data by providing better cross-validation of findings, reliably managing provenance data, and enabling tighter collaborative research, while at the same time leaving the scientist with the flexibility required for creative research?
Although several projects are devoted to finding solutions for specific aspects of a workflow design (e.g., [5–7]), on a more general level there is lack of a thorough discussion on what goals are expected from a workflow, and which of these can be realistically addressed. Here, we summarize feedback received from experimenters and theoreticians that pinpoints the fundamental problems typically encountered in the analysis of high-dimensional electrophysiological data. Illustrated by examples from our own experience, we further show obstacles that prevent us from harmonizing workflows to common guidelines. For selected issues we draw parallels to other communities that are faced with similar problems (e.g., neuronal network modeling [8, 9]; neuroimaging ). Lastly, we propose how existing concepts and software [9, 11] could assist in practically implementing workflows that are tailored to the needs of a specific project, yet guarantee high standards by adhering to general guidelines of accepted best-practice.
This project was supported by the European Union (FP7-ICT-2009-6, BrainScales).
- Brown EN, Kass RE, Mitra PP: Multiple neural spike train data analysis: state-of-the-art and future challenges. Nat Neurosci. 2004, 7: 456-461. 10.1038/nn1228.View ArticlePubMedGoogle Scholar
- Stevenson IH, Kording KP: How advances in neural recording affect data analysis. Nat Neurosci. 2011, 14: 139-142. 10.1038/nn.2731.PubMed CentralView ArticlePubMedGoogle Scholar
- Buzsáki G: Large-scale recording of neuronal ensembles. Nat Neurosci. 2004, 7: 446-451. 10.1038/nn1233.View ArticlePubMedGoogle Scholar
- Denker M, Wiebelt B, Fliegner D, Diesmann M, Morrison A: Practically trivial parallel data processing in a neuroscience laboratory. Analysis of parallel spike trains. 2010, New York: Springer-VerlagGoogle Scholar
- CARMEN: Code analysis, repository & modeling for e-neuroscience. [http://www.carmen.org.uk]
- Herz AVM, Meier R, Nawrot MP, Schiegel W, Zito T: G-Node: An integrated tool-sharing platform to support cellular and systems neurophysiology in the age of global neuroinformatics. Neural Networks. 2008, 21: 1070-1075. 10.1016/j.neunet.2008.05.011.View ArticlePubMedGoogle Scholar
- CRCNS: Collaborative research in computational neuroscience. [http://crcns.org/]
- Nordlie E, Gewaltig MO, Plesser HE: Towards reproducible descriptions of neuronal network models. PLoS Comput Biol. 2009, 5: e1000456-10.1371/journal.pcbi.1000456.PubMed CentralView ArticlePubMedGoogle Scholar
- Sumatra: automated electronic lab book: [http://neuralensemble.org/trac/sumatra]
- LONI Pipeline. [http://pipeline.loni.ucla.edu/]
- VisTrails. [http://www.vistrails.org/]; Taverna [http://www.taverna.org.uk/]; Kepler [https://kepler-project.org/]
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.