This is an old revision of the document!

{{tag>realtime}} ====== Real-time access to neurophysiological data ====== A recent development in the FieldTrip project is that we started using and extending it for real-time data analysis, feature extraction and classification. Besides data preprocessing, feature extraction and classification, which are needed for Brain-Computer Interface (BCI) and neurofeedback applications, we have added functionality for real-time processing of neuroimaging data in MATLAB in general using a common interface to the data. This page is part of the documentation series of the Fieldtrip buffer for realtime aquisition. The FieldTrip buffer is a standard that defines a central hub (the [[development:realtime|FieldTrip buffer]]) that facilitates realtime exchange of neurophysiological data. The documentation is organized in four main sections, being: - description and general [[development:realtime:buffer overview|overview of the buffer]], - definition of the [[development:realtime:buffer protocol]], - the [[development:realtime:reference implementation | reference implementation]], and - specific [[development:realtime:implementation|implementations]] that interface with acquisition software, or software platforms. - the [[/getting_started/realtime|getting started]] documentation which takes you through the first steps of real-time data streaming and analysis in MATLAB The page [[development:realtime:scratchpad]] contains some loose ends that have no clear place. ==== Frequently asked questions ==== {{topic>faq +realtime &list}} ==== Example scripts ==== {{topic>example +realtime &list}} ==== General tips and tricks ==== If you find you're getting problems you might want to think about the following: * It's useful to distinguish between reading your data (say, from a hardware device), processing steps, and writing the data (say, to a buffer). Try to separate these things both in your head and your program. * Can you nail down the source of the problems, or rather, are you really sure which of the components fails? If not, try to swap your components with something simpler. For example, in Matlab you can initially try to write the data to '%%empty://%%' instead of a FieldTrip buffer. This will help you determining whether your acquisition part works correctly. The other way round, you can use the **[[:reference:ft_realtime_signalproxy]]** (or ideas from it) to check whether the writing part works. * Are you having performance problems? Maybe you can initially try to reduce the number of channels or the sample rate, and check whether the program logic is right. * How much data are you trying to move? If for example you want to write to a buffer on a remote machine, you need to be aware of the physical limits of the network connection. * You can try moving the actual buffer to another machine, and you do not need to have the buffer attached to a Matlab session (try using ''demo_buffer''). * You can try to report and compare the wall clock time with the sample time. Here, wall clock time refers to the real time your computer has run since you started the acquisition loop, while sample time is given by the amount of data processed so far, divided by your sampling frequency. These two numbers should ideally be the same or have a small constant offset, but they should not drift apart. Successive sample and clock times should also match your blocksize, that is, if you always read 500 samples at a time from a device, and your sampling rate is 1000 Hz, your measured clock time and calculated sample time should increase roughly by 0.5 seconds after each block. ==== Publications using FieldTrip buffer ==== The following is a list of papers that made use of the FieldTrip buffer or referred to it. If you have published a paper which uses the FieldTrip buffer and which is not yet listed here, feel free to add it! Just click the edit button (under Page tools) at the top of this page. <inlinebib> @article{mayaud2013robust, title={Robust Brain-computer Interface for virtual Keyboard (RoBIK): Project results}, author={Mayaud, L. and Filipe, S. and Petegnief, L. and Rochecouste, O. and Congedo, M.}, journal={IRBM}, year={2013}, publisher={Elsevier} } @article{stolk2012online, title={Online and offline tools for head movement compensation in MEG}, author={Stolk, A. and Todorovic, A. and Schoffelen, J-M. and Oostenveld, R.}, journal={Neuroimage}, year={2012}, publisher={Elsevier} } @phdthesis{soldati2012novel, title={Novel data-driven analysis methods for real-time fMRI and simultaneous EEG-fMRI neuroimaging}, author={Soldati, N.}, year={2012}, school={University of Trento} } @article{oostenveld2011fieldtrip, title={FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data}, author={Oostenveld, R. and Fries, P. and Maris, E. and Schoffelen, J-M.}, journal={Computational intelligence and neuroscience}, volume={2011}, pages={1}, year={2011}, publisher={Hindawi Publishing Corp.} } @article{sudre2011rtmeg, title={rtMEG: a real-time software interface for magnetoencephalography}, author={Sudre, G. and Parkkonen, L. and Bock, E. and Baillet, S. and Wang, W. and Weber, D. J.}, journal={Computational intelligence and neuroscience}, volume={2011}, pages={11}, year={2011}, publisher={Hindawi Publishing Corp.} } @article{degenhart2011craniux, title={Craniux: a LabVIEW-based modular software framework for brain-machine interface research}, author={Degenhart, A. D. and Kelly, J. W. and Ashmore, R. C. and Collinger, J. L. and Tyler-Kabara, E. C. and Weber, D. J. and Wang, W.}, journal={Computational intelligence and neuroscience}, volume={2011}, pages={6}, year={2011}, publisher={Hindawi Publishing Corp.} } @article{jenen2011using, title={Using brain--computer interfaces and brain-state dependent stimulation as tools in cognitive neuroscience}, author={Jensen, O. and Bahramisharif, A. and Oostenveld, R. and Klanke, S. and Hadjipapas, A. and Okazaki, Y. O. and van Gerven, M. A. J.}, journal={Frontiers in psychology}, volume={2}, year={2011}, publisher={Frontiers Media SA} } @incollection{delorme2010matlab, title={MATLAB-based tools for BCI research}, author={Delorme, A. and Kothe, C. and Vankov, A. and Bigdely-Shamlo, N. and Oostenveld, R. and Zander, T. O. and Makeig, S.}, booktitle={Brain-Computer Interfaces}, pages={241--259}, year={2010}, publisher={Springer} } @inproceedings{schalk2009effective, title={Effective brain-computer interfacing using BCI2000}, author={Schalk, G.}, booktitle={Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE}, pages={5498--5501}, year={2009}, organization={IEEE} } </inlinebib>