The ‘Sandwich’ meta-framework for architecture agnostic deep privacy-preserving transfer learning for non-invasive brainwave decoding
File(s)
Published version
Author(s)
Wei, Xiaoxi
Narayan, Jyotindra
Faisal, A Aldo
Type
Journal Article
Abstract
Objective. Machine learning has enhanced the performance of decoding signals indicating human behaviour. Electroencephalography (EEG) brainwave decoding, as an exemplar indicating neural activity and human thoughts non-invasively, has been helpful in neural activity analysis and aiding paralysed patients via brain-computer interfaces. However, training machine learning algorithms on EEG encounters two primary challenges: variability across data sets and privacy concerns using data from individuals and data centres. Our objective is to address these challenges by integrating transfer learning for data variability and federated learning for data privacy into a unified approach. Approach. We introduce the ‘Sandwich’ as a novel deep privacy-preserving meta-framework combining transfer learning and federated learning. The ‘Sandwich’ framework comprises three components: federated networks (first layers) that handle data set differences at the input level, a shared network (middle layer) learning common rules and applying transfer learning techniques, and individual classifiers (final layers) for specific brain tasks of each data set. This structure enables the central network (central server) to benefit from multiple data sets, while local branches (local servers) maintain data and label privacy. Main results. We evaluated the ‘Sandwich’ meta-architecture in various configurations using the BEETL motor imagery challenge, a benchmark for heterogeneous EEG data sets. Compared with baseline models like Shallow ConvNet and EEGInception, our ‘Sandwich’ implementations showed superior performance. The best-performing model, the Inception SanDwich with deep set alignment (Inception-SD-Deepset), exceeded baseline methods by 9%. Significance. The ‘Sandwich’ framework demonstrates advancements in federated deep transfer learning for diverse tasks and data sets. It outperforms conventional deep learning methods, showcasing the potential for effective use of larger, heterogeneous data sets with enhanced privacy. In addition, through its diverse implementations with various backbone architectures and transfer learning approaches, the ‘Sandwich’ framework shows the potential as a model-agnostic meta-framework for decoding time series data like EEG, suggesting a direction towards large-scale brainwave decoding by combining deep transfer learning with privacy-preserving federated learning.
Date Issued
2025-02-01
Date Acceptance
2024-12-02
Citation
Journal of Neural Engineering, 2025, 22 (1)
ISSN
1741-2560
Publisher
IOP Publishing
Journal / Book Title
Journal of Neural Engineering
Volume
22
Issue
1
Copyright Statement
© 2025 The Author(s). Published by IOP Publishing Ltd Original Content from this work may be used under the terms of the Creative Commons Attribution 4.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
License URL
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/39622169
Subjects
brain-computer-interfaces (BCI)
deep learning
electroencephalography (EEG)
federated machine learning
heterogenous datasets
privacy-preserving
transfer learning
Electroencephalography
Deep Learning
Humans
Brain-Computer Interfaces
Privacy
Brain Waves
Publication Status
Published
Coverage Spatial
England
Article Number
016014
Date Publish Online
2025-01-23