A survey on active learning and human-in-the-loop deep learning for medical image analysis
File(s)Deep_Active_HITL__Arxiv_Copy___Revision_2_Copy_.pdf (574.15 KB)
Accepted version
Author(s)
Budd, Samuel
Robinson, Emma
Kainz, Bernhard
Type
Journal Article
Abstract
Fully automatic deep learning has become the state-of-the-art technique for many tasks including image acquisition, analysis andinterpretation, and for the extraction of clinically useful information for computer-aided detection, diagnosis, treatment planning,intervention and therapy. However, the unique challenges posed by medical image analysis suggest that retaining a human end-user in any deep learning enabled system will be beneficial. In this review we investigate the role that humans might play in thedevelopment and deployment of deep learning enabled diagnostic applications and focus on techniques that will retain a significantinput from a human end user. Human-in-the-Loop computing is an area that we see as increasingly important in future research dueto the safety-critical nature of working in the medical domain. We evaluate four key areas that we consider vital for deep learningin the clinical practice: (1)Active Learningto choose the best data to annotate for optimal model performance; (2)Interaction withmodel outputs- using iterative feedback to steer models to optima for a given prediction and offering meaningful ways to interpretand respond to predictions; (3) Practical considerations- developing full scale applications and the key considerations that need tobe made before deployment; (4)Future Prospective and Unanswered Questions- knowledge gaps and related research fields thatwill benefit human-in-the-loop computing as they evolve. We offer our opinions on the most promising directions of research andhow various aspects of each area might be unified towards common goals.
Date Issued
2021-07-01
Date Acceptance
2021-04-07
Citation
Medical Image Analysis, 2021, 71
ISSN
1361-8415
Publisher
Elsevier
Journal / Book Title
Medical Image Analysis
Volume
71
Copyright Statement
© 2021 Elsevier B.V. All rights reserved. . This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence http://creativecommons.org/licenses/by-nc-nd/4.0/
Sponsor
Innovate UK
Engineering and Physical Sciences Research Council (EPSRC)
Engineering & Physical Science Research Council (EPSRC)
Grant Number
104691
EP/S013687/1
EP/S013687/1
Subjects
Active learning
Deep Learning
Human-in-the-Loop
Medical image analysis
Nuclear Medicine & Medical Imaging
09 Engineering
11 Medical and Health Sciences
Publication Status
Published
Article Number
ARTN 102062
Date Publish Online
2021-04-09