Combining Human Body Shape and Pose Estimation for Robust Upper Body Tracking Using a Depth Sensor

Thomas Probst, Andrea Fossati, Luc Van Gool
14th European Conference on Computer Vision (ECCV 2016 Workshops)
Amsterdam, The Netherlands, October 2016

---

Abstract

Rapid and accurate estimation of a person’s upper body shape and real-time tracking of the pose in the presence of occlusions is crucial for many future assistive technologies, health care applications and telemedicine systems. We propose to tackle this challenging problem by combining data-driven and generative methods for both body shape and pose estimation. Our strategy comprises a subspace-based method to predict body shape directly from a single depth map input, and a random forest regression approach to obtain a sound initialization for pose estimation of the upper body. We propose a model-fitting strat- egy in order to refine the estimated body shape and to exploit body shape information for improving pose accuracy. During tracking, we feed refinement results back into the forest-based joint position regressor to stabilize and accelerate pose estimation over time. Our tracking frame- work is designed to cope with viewpoint limitations and occlusions due to dynamic objects.

---

Download in pdf format

---

@InProceedings{eth_biwi_01324,
  author = {Thomas Probst and Andrea Fossati and Luc Van Gool},
  title = {Combining Human Body Shape and Pose Estimation for Robust Upper Body Tracking Using a Depth Sensor},
  booktitle = {14th European Conference on Computer Vision (ECCV 2016 Workshops)},
  year = {2016},
  month = {October},
  pages = {285-301},
  volume = {9913},
  editor = {Hua and Gang and Jégou and Hervé},
  series = {LNCS},
  publisher = {Springer},
  keywords = {human pose estimation, human body shape, pose tracking, model fitting, real-time, occlusion handling, random forest, subspace}
}