Light-field microscopy for optical imaging of neuronal activity: when model-based methods meet data-driven approaches
File(s)FullPaper_SPM_DL_BioImageProc_V9_Final.pdf (5.74 MB)
Accepted version
Author(s)
Foust, Amanda
Song, pingfan
Verinaz Jadan, Herman Isaac
Howe, carmel
Dragotti, pier luigi
Type
Journal Article
Abstract
Understanding how networks of neurons process information is one of the key challenges in modern neuroscience.
A necessary step to achieve this goal is to be able to observe the dynamics of large populations of neurons over
a large area of the brain. Light-field microscopy (LFM), a type of scanless microscope, is a particularly attractive
candidate for high-speed three-dimensional (3D) imaging. It captures volumetric information in a single snapshot,
allowing volumetric imaging at video frame-rates. Specific features of imaging neuronal activity using LFM call
for the development of novel machine learning approaches that fully exploit priors embedded in physics and optics
models. Signal processing theory and wave-optics theory could play a key role in filling this gap, and contribute
to novel computational methods with enhanced interpretability and generalization by integrating model-driven and
data-driven approaches. This paper is devoted to a comprehensive survey to state-of-the-art of computational methods for LFM, with a focus on model-based and data-driven approaches
A necessary step to achieve this goal is to be able to observe the dynamics of large populations of neurons over
a large area of the brain. Light-field microscopy (LFM), a type of scanless microscope, is a particularly attractive
candidate for high-speed three-dimensional (3D) imaging. It captures volumetric information in a single snapshot,
allowing volumetric imaging at video frame-rates. Specific features of imaging neuronal activity using LFM call
for the development of novel machine learning approaches that fully exploit priors embedded in physics and optics
models. Signal processing theory and wave-optics theory could play a key role in filling this gap, and contribute
to novel computational methods with enhanced interpretability and generalization by integrating model-driven and
data-driven approaches. This paper is devoted to a comprehensive survey to state-of-the-art of computational methods for LFM, with a focus on model-based and data-driven approaches
Date Issued
2022-02-24
Date Acceptance
2021-10-22
Citation
IEEE: Signal Processing Magazine, 2022, 39 (2)
ISSN
1053-5888
Publisher
Institute of Electrical and Electronics Engineers
Journal / Book Title
IEEE: Signal Processing Magazine
Volume
39
Issue
2
Copyright Statement
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Royal Academy Of Engineering
Wellcome Trust
Biotechnology and Biological Sciences Research Council (BBSRC)
Biotechnology and Biological Sciences Research Council (BBSRC)
Identifier
https://ieeexplore.ieee.org/document/9721178
Grant Number
RF1415\14\26
201964/Z/16/Z
BB/R009007/1
EP/V520354/1
Subjects
Science & Technology
Technology
Engineering, Electrical & Electronic
Engineering
Three-dimensional displays
Microscopy
Computational modeling
Neurons
Sociology
Signal processing algorithms
Optical imaging
TECHNOLOGIES
Deep learning
Light-field microscopy
Neuroimaging
model-driven and data-driven approaches
Networking & Telecommunications
0801 Artificial Intelligence and Image Processing
0906 Electrical and Electronic Engineering
0913 Mechanical Engineering
Publication Status
Published
Date Publish Online
2022-02-24