Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

Outdoor Human Motion Capture using Inverse Kinematics and von Mises-Fisher Sampling

G. Pons-Moll and A. Baak and J. Gall and L. Leal-Taixé and M. Mueller and H.-P. Seidel and B. Rosenhahn
International Conference on Computer Vision (ICCV)
2011

Abstract

Human motion capturing (HMC) from multi-view image sequences is an extremely difficult problem due to depth and orientation ambiguities and the high dimensionality of the state space. In this paper, we introduce a novel hybrid HMC system that combines video input with sparse inertial sensor input. Employing an annealing particle-based optimization scheme, our idea is to use orientation cues derived from the inertial input to sample particles from the manifold of valid poses. Then, visual cues derived from the video input are used to weight these particles and to iteratively derive the final pose. As our main contribution, we propose an efficient sampling procedure where the particles are derived analytically using inverse kinematics on the orientation cues. Additionally, we introduce a novel sensor noise model to account for uncertainties based on the von Mises-Fisher distribution. Doing so, orientation constraints are naturally fulfilled and the number of needed particles can be kept very small. More generally, our method can be used to sample poses that fulfill arbitrary orientation or positional kinematic constraints. In the experiments, we show that our system can track even highly dynamic motions in an outdoor environment with changing illumination, background clutter, and shadows.


Download in pdf format
@InProceedings{eth_biwi_00862,
  author = {G. Pons-Moll and A. Baak and J. Gall and L. Leal-TaixĂ© and M. Mueller and H.-P. Seidel and B. Rosenhahn},
  title = {Outdoor Human Motion Capture using Inverse Kinematics and von Mises-Fisher Sampling},
  booktitle = {International Conference on Computer Vision (ICCV)},
  year = {2011},
  keywords = {}
}