BodySLAM: Joint Camera Localisation, Mapping, and Human Motion Tracking
File(s)2205.02301v3.pdf (2 MB)
Working paper
Author(s)
Henning, Dorian F
Laidlow, Tristan
Leutenegger, Stefan
Type
Working Paper
Abstract
Estimating human motion from video is an active research area due to its many
potential applications. Most state-of-the-art methods predict human shape and
posture estimates for individual images and do not leverage the temporal
information available in video. Many "in the wild" sequences of human motion
are captured by a moving camera, which adds the complication of conflated
camera and human motion to the estimation. We therefore present BodySLAM, a
monocular SLAM system that jointly estimates the position, shape, and posture
of human bodies, as well as the camera trajectory. We also introduce a novel
human motion model to constrain sequential body postures and observe the scale
of the scene. Through a series of experiments on video sequences of human
motion captured by a moving monocular camera, we demonstrate that BodySLAM
improves estimates of all human body parameters and camera poses when compared
to estimating these separately.
potential applications. Most state-of-the-art methods predict human shape and
posture estimates for individual images and do not leverage the temporal
information available in video. Many "in the wild" sequences of human motion
are captured by a moving camera, which adds the complication of conflated
camera and human motion to the estimation. We therefore present BodySLAM, a
monocular SLAM system that jointly estimates the position, shape, and posture
of human bodies, as well as the camera trajectory. We also introduce a novel
human motion model to constrain sequential body postures and observe the scale
of the scene. Through a series of experiments on video sequences of human
motion captured by a moving monocular camera, we demonstrate that BodySLAM
improves estimates of all human body parameters and camera poses when compared
to estimating these separately.
Date Issued
2022-08-06
Citation
2022
Publisher
ArXiv
Copyright Statement
©2022 The Author(s)
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Engineering & Physical Science Research Council (EPSRC)
Dyson Technology Limited
Engineering & Physical Science Research Council (E
Identifier
http://arxiv.org/abs/2205.02301v3
Grant Number
EP/N018494/1
EP/S036636/1
PO4500503359
Stream B - EP/W001136/1
Subjects
cs.CV
cs.CV
cs.RO
Notes
ECCV 2022. Video: https://youtu.be/0-SL3VeWEvU
Publication Status
Published