Real-time multi-person pose tracking using data assimilation
File(s)
Author(s)
Buizza, Caterina
Fischer, Tobias
Demiris, Yiannis
Type
Conference Paper
Abstract
We propose a framework for the integration of data assimilation and machine learning methods in human pose estimation, with the aim of enabling any pose estimation method to be run in real-time, whilst also increasing consistency and accuracy. Data assimilation and machine learning are complementary methods: the former allows us to make use of information about the underlying dynamics of a system but lacks the flexibility of a data-based model, which we can instead obtain with the latter. Our framework presents a real-time tracking module for any single or multi-person pose estimation system. Specifically, tracking is performed by a number of Kalman filters initiated for each new person appearing in a motion sequence. This permits tracking of multiple skeletons and reduces the frequency that computationally expensive pose estimation has to be run, enabling online pose tracking. The module tracks for N frames while the pose estimates are calculated for frame (N+1). This also results in increased consistency of person identification and reduced inaccuracies due to missing joint locations and inversion of left-and right-side joints.
Date Acceptance
2019-12-10
Citation
IEEE Winter Conference on Applications of Computer Vision
Publisher
IEEE
Journal / Book Title
IEEE Winter Conference on Applications of Computer Vision
Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Identifier
http://openaccess.thecvf.com/content_WACV_2020/html/Buizza_Real-Time_Multi-Person_Pose_Tracking_using_Data_Assimilation_WACV_2020_paper.html
Source
IEEE Winter Conference on Applications of Computer Vision
Publication Status
Accepted
Start Date
2020-03-02
Finish Date
2020-03-05
Coverage Spatial
Snowmass Village, Colorado, USA