Embed2Rule scalable neuro-symbolic learning via latent space weak-labelling
File(s)Embed2Rule.pdf (709.64 KB) Fwd_ NeSy 2024 acceptance notification for REGULAR papers 34.txt (16.02 KB)
Accepted version
Supporting information
Author(s)
Aspis, Yaniv
Albinhassan, Mohammad
Russo, Alessandra
Lobo, Jorge
Type
Conference Paper
Abstract
Neuro-symbolic approaches have garnered much interest recently as a path toward endowing neural systems with robust reasoning capabilities. Most proposed end-to-end methods assume knowledge to be given in advance and do not scale up over many latent concepts. The recently proposed Embed2Sym tackles the scalability limitation by
performing end-to-end neural training of a visual perception component from downstream labels to generate clusters in the latent space of symbolic concepts. These are later used to perform downstream symbolic reasoning but symbolic knowledge is still engineered. Taking inspiration from Embed2Sym, this paper introduces a novel method for scalable neuro-symbolic learning of first-order logic programs from raw data. The learned clusters are optimally labelled using sampled predictions of a pre-trained vision-language model. A SOTA symbolic learner, robust to
noise, uses these labels to learn an answer set program that solves the reasoning task. Our approach, called Embed2Rule, is shown to achieve better accuracy than SOTA neuro-symbolic systems on existing bench-mark tasks in most cases while scaling up to tasks that require far more
complex reasoning and a large number of latent concepts.
performing end-to-end neural training of a visual perception component from downstream labels to generate clusters in the latent space of symbolic concepts. These are later used to perform downstream symbolic reasoning but symbolic knowledge is still engineered. Taking inspiration from Embed2Sym, this paper introduces a novel method for scalable neuro-symbolic learning of first-order logic programs from raw data. The learned clusters are optimally labelled using sampled predictions of a pre-trained vision-language model. A SOTA symbolic learner, robust to
noise, uses these labels to learn an answer set program that solves the reasoning task. Our approach, called Embed2Rule, is shown to achieve better accuracy than SOTA neuro-symbolic systems on existing bench-mark tasks in most cases while scaling up to tasks that require far more
complex reasoning and a large number of latent concepts.
Date Issued
2024-09-10
Date Acceptance
2024-06-15
Citation
Lecture Notes in Computer Science, 2024, 14979, pp.195-218
ISBN
978-3-031-71167-1
ISSN
1611-3349
Publisher
Springer
Start Page
195
End Page
218
Journal / Book Title
Lecture Notes in Computer Science
Volume
14979
Copyright Statement
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Identifier
https://link.springer.com/chapter/10.1007/978-3-031-71167-1_11
Source
NeSy2024 - 18th International Conference on Neural-Symbolic Learning and Reasoning,
Publication Status
Published
Start Date
2024-09-09
Finish Date
2024-09-12
Coverage Spatial
Barcelona, Spain
Date Publish Online
2024-09-10