MID-fusion: octree-based object-level multi-instance dynamic SLAM

File Description SizeFormat 
1812.07976v3.pdfFile embargoed until 01 January 100007.31 MBAdobe PDF    Request a copy
Title: MID-fusion: octree-based object-level multi-instance dynamic SLAM
Authors: Xu, B
Li, W
Tzoumanikas, D
Bloesch, M
Davison, A
Leutenegger, S
Item Type: Conference Paper
Abstract: We propose a new multi-instance dynamic RGB-D SLAM system using an object-level octree-based volumetric representation. It can provide robust camera tracking in dynamic environments and at the same time, continuously estimate geometric, semantic, and motion properties for arbitrary objects in the scene. For each incoming frame, we perform instance segmentation to detect objects and refine mask boundaries using geometric and motion information. Meanwhile, we estimate the pose of each existing moving object using an object-oriented tracking method and robustly track the camera pose against the static scene. Based on the estimated camera pose and object poses, we associate segmented masks with existing models and incrementally fuse corresponding colour, depth, semantic, and foreground object probabilities into each object model. In contrast to existing approaches, our system is the first system to generate an object-level dynamic volumetric map from a single RGB-D camera, which can be used directly for robotic tasks. Our method can run at 2-3 Hz on a CPU, excluding the instance segmentation part. We demonstrate its effectiveness by quantitatively and qualitatively testing it on both synthetic and real-world sequences.
Issue Date: 1-May-2019
Date of Acceptance: 1-May-2019
URI: http://hdl.handle.net/10044/1/71340
Publisher: IEEE
Copyright Statement: This paper is embargoed until publication.
Sponsor/Funder: Engineering & Physical Science Research Council (EPSRC)
Funder's Grant Number: EP/N018494/1
Conference Name: ICRA 2019- IEEE International Conference on Robotics and Automation
Keywords: cs.RO
cs.RO
cs.CV
cs.RO
cs.RO
cs.CV
Notes: Accepted to International Conference on Robotics and Automation (ICRA) 2019. 7 (6 + 1) pages. Please also see video Link: https://youtu.be/gturboNl9gg
Publication Status: Accepted
Start Date: 2019-05-20
Finish Date: 2019-05-24
Conference Place: Montreal, Canada
Embargo Date: publication subject to indefinite embargo
Appears in Collections:Faculty of Engineering
Computing



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons