CCN+: a neuro-symbolic framework for deep learning with requirements
File(s)1-s2.0-S0888613X24000112-main.pdf (2.52 MB)
Published version
Author(s)
Giunchiglia, Eleonora
Tatomir, Alex
Stoian, Mihaela Cătălina
Lukasiewicz, Thomas
Type
Journal Article
Abstract
For their outstanding ability of finding hidden patterns in data, deep learning models have been extensively applied in many different domains. However, recent works have shown that, if a set of requirements expressing inherent knowledge about the problem at hand is given, then neural networks often fail to comply with them. This represents a major drawback for deep learning models, as requirements compliance is normally considered a necessary condition for standard software deployment. In this paper, we propose a novel neuro-symbolic framework able to make any neural network compliant by design to a given set of requirements over the output space expressed in full propositional logic. This framework, called CCN+, integrates the requirements into the output layer of the neural network by applying multiple inference rules that ensure compliance with the requirements and adapts the standard binary cross-entropy loss function to the requirement output layer. As a result, not only the outputted predictions are guaranteed to be compliant with the requirements, but the neural network itself learns how to exploit the domain knowledge expressed by the requirements to get better performance. We conduct an extensive experimental evaluation of CCN+ on 19 real-world multi-label classification datasets with propositional logic requirements, including a challenging dataset for autonomous driving. Our experimental analysis confirms that CCN+ is able to outperform both its neural counterparts and the state-of-the-art models.
Date Issued
2024-08-01
Date Acceptance
2024-01-11
Citation
International Journal of Approximate Reasoning, 2024, 171
ISSN
0888-613X
Publisher
Elsevier BV
Journal / Book Title
International Journal of Approximate Reasoning
Volume
171
Copyright Statement
© 2024 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
License URL
Identifier
10.1016/j.ijar.2024.109124
Publication Status
Published
Article Number
109124
Date Publish Online
2024-01-22