Semantic Texture for Robust Dense Tracking
File(s)1708.08844v1.pdf (8.02 MB)
Accepted version
Author(s)
Czarnowski, Jan
Leutenegger, Stefan
Davison, Andrew J
Type
Conference Paper
Abstract
We argue that robust dense SLAM systems can make valuable use of the layers of features coming from a standard CNN as a pyramid of `semantic texture' which is suitable for dense alignment while being much more robust to nuisance factors such as lighting than raw RGB values. We use a straightforward Lucas-Kanade formulation of image alignment, with a schedule of iterations over the coarse-to-fine levels of a pyramid, and simply replace the usual image pyramid by the hierarchy of convolutional feature maps from a pre-trained CNN. The resulting dense alignment performance is much more robust to lighting and other variations, as we show by camera rotation tracking experiments on time-lapse sequences captured over many hours. Looking towards the future of scene representation for real-time visual SLAM, we further demonstrate that a selection using simple criteria of a small number of the total set of features output by a CNN gives just as accurate but much more efficient tracking performance.
Date Issued
2018-01-23
Date Acceptance
2017-10-22
Citation
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2018, pp.851-859
ISSN
2473-9936
Publisher
IEEE
Start Page
851
End Page
859
Journal / Book Title
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017)
Copyright Statement
© The Authors
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000425239600097&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Source
16th IEEE International Conference on Computer Vision (ICCV)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Engineering, Electrical & Electronic
Computer Science
Engineering
Publication Status
Published
Start Date
2017-10-22
Finish Date
2017-10-29
Coverage Spatial
Venice, ITALY
Date Publish Online
2018-01-23