Resource-efficient medical image analysis with self-adapting forward-forward networks
OA Location
Author(s)
Mueller, Johanna P
Kainz, Bernhard
Type
Chapter
Abstract
We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for model training and fine-tuning. Building upon the recently proposed Forward-Forward Algorithm (FFA), we introduce the Convolutional Forward-Forward Algorithm (CFFA), a parameter-efficient reformulation that is suitable for advanced image analysis and overcomes the speed and generalisation constraints of the original FFA. To address hyper-parameter sensitivity of FFAs we are also introducing a self-adapting framework SaFF-Net fine-tuning parameters during warmup and training in parallel. Our approach enables more effective model training and eliminates the previously essential requirement for an arbitrarily chosen Goodness function in FFA. We evaluate our approach on several benchmarking datasets in comparison with standard Back-Propagation (BP) neural networks showing that FFA-based networks with notably fewer parameters and function evaluations can compete with standard models, especially, in one-shot scenarios and large batch sizes.
Editor(s)
Xu, X
Date Issued
2024-10-23
Citation
Machine Learning in Medical Imaging, 2024, 15242, pp.180-190
ISBN
978-3-031-73292-8
Publisher
Springer Nature Switzerland AG
Start Page
180
End Page
190
Journal / Book Title
Machine Learning in Medical Imaging
Lecture Notes in Computer Science
Volume
15242
Copyright Statement
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG.
Subjects
Computer Science
Publication Status
Published
Date Publish Online
2024-10-23