Repository logo
  • Log In
    Log in via Symplectic to deposit your publication(s).
Repository logo
  • About
  • Communities & Collections
  • Advanced Search
  • Statistics
  • Log In
    Log in via Symplectic to deposit your publication(s).
  1. Home
  2. Faculty of Engineering
  3. Computing
  4. Computing
  5. Detect, understand, act: a neuro-symbolic hierarchical reinforcement learning framework
 
  • Details
Detect, understand, act: a neuro-symbolic hierarchical reinforcement learning framework
File(s)
Mitchener2022_Article_DetectUnderstandActANeuro-symb.pdf (1.69 MB)
Published version
Author(s)
Mitchener, Ludovico
Tuckey, David
Crosby, Matthew
Russo, Alessandra
Type
Journal Article
Abstract
In this paper we introduce Detect, Understand, Act (DUA), a neuro-symbolic reinforcement learning framework. The Detect component is composed of a traditional computer vision object detector and tracker. The Act component houses a set of options, high-level actions enacted by pre-trained deep reinforcement learning (DRL) policies. The Understand component provides a novel answer set programming (ASP) paradigm for symbolically implementing a meta-policy over options and effectively learning it using inductive logic programming (ILP). We evaluate our framework on the Animal-AI (AAI) competition testbed, a set of physical cognitive reasoning problems. Given a set of pre-trained DRL policies, DUA requires only a few examples to learn a meta-policy that allows it to improve the state-of-the-art on multiple of the most challenging categories from the testbed. DUA constitutes the first holistic hybrid integration of computer vision, ILP and DRL applied to an AAI-like environment and sets the foundations for further use of ILP in complex DRL challenges.
Date Issued
2022-04-07
Date Acceptance
2022-02-07
Citation
Machine Learning, 2022, 111, pp.1523-1549
URI
http://hdl.handle.net/10044/1/96353
URL
https://link.springer.com/article/10.1007/s10994-022-06142-7
DOI
https://www.dx.doi.org/10.1007/s10994-022-06142-7
ISSN
0885-6125
Publisher
Springer Science and Business Media LLC
Start Page
1523
End Page
1549
Journal / Book Title
Machine Learning
Volume
111
Copyright Statement
© The Author(s) 2022
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
License URL
http://creativecommons.org/licenses/by/4.0/
Identifier
https://link.springer.com/article/10.1007/s10994-022-06142-7
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Computer Science
Neuro-symbolic
Hierarchical reinforcement learning
Deep reinforcement learning
Inductive logic programming
Answer set programming
0801 Artificial Intelligence and Image Processing
0806 Information Systems
1702 Cognitive Sciences
Artificial Intelligence & Image Processing
Publication Status
Published
Date Publish Online
2022-04-07
About
Spiral Depositing with Spiral Publishing with Spiral Symplectic
Contact us
Open access team Report an issue
Other Services
Scholarly Communications Library Services
logo

Imperial College London

South Kensington Campus

London SW7 2AZ, UK

tel: +44 (0)20 7589 5111

Accessibility Modern slavery statement Cookie Policy

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback