Robust training of neural networks against bias field perturbations
File(s)aaai.pdf (240.63 KB)
Accepted version
Author(s)
Henriksen, Patrick
Lomuscio, Alessio
Type
Conference Paper
Abstract
Robust training of neural networks has so far been developed in the context of white noise perturbations to limit their susceptibility to adversarial attacks. However, in applications neural networks need to be robust to a wider range of input perturbations, including contrast, brightness, and beyond. We here introduce the problem of training neural networks such that they are robust against a class of smooth intensity perturbations modelled by bias fields. We first develop an approach towards this goal based on a State-of-the-Art (SoA) robust training method utilising Interval Bound Propagation (IBP). We analyse the resulting algorithm and observe that IBP often produces very loose bounds for bias field perturbations, which may be detrimental to training. We propose an alternative approach based on Symbolic Interval Propagation (SIP), which usually results in significantly tighter bounds than IBP. We present ROBNET, a tool implementing these approaches for bias field robust training. In experiments networks trained with the SIP-based approach achieved up to 31% higher certified robustness while also maintaining a better accuracy than networks trained with the IBP approach.
Date Issued
2023-06-26
Date Acceptance
2022-11-18
Citation
Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI23), 2023, 37 (12), pp.14865-14873
ISSN
2374-3468
Publisher
AAAI
Start Page
14865
End Page
14873
Journal / Book Title
Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI23)
Volume
37
Issue
12
Copyright Statement
© 2023, Association for the Advancement of Artificial
Intelligence (www.aaai.org). All rights reserved.
Intelligence (www.aaai.org). All rights reserved.
Source
AAAI Conference on Artificial Intelligence (AAAI23)
Publication Status
Published
Start Date
2023-02-07
Finish Date
2023-02-14
Coverage Spatial
Washington, DC