Data augmentation for self-paced motor imagery classification with C-LSTM.
File(s)
Author(s)
Freer, Daniel
Yang, Guang-Zhong
Type
Journal Article
Abstract
OBJECTIVE: Brain Computer Interfaces (BCI) are becoming important tools for assistive technology, particularly through the use of Motor Imagery (MI) for aiding task completion. However, most existing methods of MI classification have been applied in a trial-wise fashion, with window sizes of approximately 2 seconds or more. Application of this type of classifier could cause a delay when switching between MI events. APPROACH: In this study, state-of-the-art classification methods for motor imagery are assessed with considerations for real-time and self-paced control, and a Convolutional Long-Short Term Memory (C-LSTM) network based on Filter Bank Common Spatial Patterns (FBCSP) is proposed. In addition, the effects of several methods of data augmentation on different classifiers are explored. MAIN RESULTS: The results of this study show that the proposed network achieves adequate results in distinguishing between different control classes, but both considered deep learning models are still less reliable than a Riemannian Minimum Distance to the Mean (MDM) classifier. In addition, controlled skewing of the data and the explored data augmentation methods improved the average overall accuracy of the classifiers by 14.0% and 5.3%, respectively. SIGNIFICANCE: This manuscript is among the first to attempt combining convolutional and recurrent neural network layers for the purpose of MI classification, and is also one of the first to provide an in-depth comparison of various data augmentation methods for MI classification. In addition, all of these methods are applied on smaller windows of data and with consideration to ambient data, which provides a more realistic test bed for real-time and self-paced control.
Date Issued
2020-01-31
Date Acceptance
2019-11-14
Citation
Journal of Neural Engineering, 2020, 17 (1), pp.1-15
ISSN
1741-2552
Publisher
IOP Publishing
Start Page
1
End Page
15
Journal / Book Title
Journal of Neural Engineering
Volume
17
Issue
1
Copyright Statement
© 2020 IOP Publishing Ltd.
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/31726440
Subjects
Brain Computer Interface
Data Augmentation
Deep Learning
Electroencephalography
Motor Imagery
Publication Status
Published
Coverage Spatial
England
Date Publish Online
2019-11-14