Learning to complete object shapes for object-level mapping in dynamic scenes
File(s)2208.05067v1.pdf (16.52 MB)
Accepted version
Author(s)
Xu, Binbin
Davison, Andrew J
Leutenegger, Stefan
Type
Conference Paper
Abstract
In this paper, we propose a novel object-level mapping system that can simultaneously segment, track, and reconstruct objects in dynamic scenes. It can further predict and complete their full geometries by conditioning on reconstructions from depth inputs and a category-level shape prior with the aim that completed object geometry leads to better object reconstruction and tracking accuracy. For each incoming RGB-D frame, we perform instance segmentation to detect objects and build data associations between the detection and the existing object maps. A new object map will be created for each unmatched detection. For each matched object, we jointly optimise its pose and latent geometry representations using geometric residual and differential rendering residual towards its shape prior and completed geometry. Our approach shows better tracking and reconstruction performance compared to methods using traditional volumetric mapping or learned shape prior approaches. We evaluate its effectiveness by quantitatively and qualitatively testing it in both synthetic and real-world sequences.
Date Issued
2022-12-26
Date Acceptance
2022-12-01
Citation
2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, pp.2257-2264
Publisher
IEEE
Start Page
2257
End Page
2264
Journal / Book Title
2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Copyright Statement
Copyright © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
https://ieeexplore.ieee.org/document/9981545
Source
2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Publication Status
Published
Start Date
2022-10-23
Finish Date
2022-10-27
Coverage Spatial
Kyoto, Japan
Date Publish Online
2022-12-26