This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Articulated Multibody Tracking Under Egomotion

S. Gammeter, A. Ess, T. Jaeggli, K. Schindler, B. Leibe, and L. van Gool
European Conference on Computer Vision (ECCV'08)
October 2008


In this paper, we address the problem of 3D articulated multi-person tracking in busy street scenes from a moving, human-level observer. In order to handle the complexity of multi-person interactions, we propose to pursue a two-stage strategy. A multi-body detection-based tracker first analyzes the scene and recovers individual pedestrian trajectories, bridging sensor gaps and resolving temporary occlusions. A specialized articulated tracker is then applied to each recovered pedestrian trajectory in parallel to estimate the tracked person's precise body pose over time. This articulated tracker is implemented in a Gaussian Process framework and operates on global pedestrian silhouettes using a learned statistical representation of human body dynamics. We interface the two tracking levels through a guided segmentation stage, which combines traditional bottom-up cues with top-down information from a human detector and the articulated tracker's shape prediction. We show the proposed approach's viability and demonstrate its performance for articulated multi-person tracking on several challenging video sequences of a busy inner-city scenario.

Download in pdf format
  author = {S. Gammeter and A. Ess and T. Jaeggli and K. Schindler and B. Leibe and and L. van Gool},
  title = {Articulated Multibody Tracking Under Egomotion},
  booktitle = {European Conference on Computer Vision (ECCV'08)},
  year = {2008},
  month = {October},
  series = {LNCS},
  publisher = {Springer},
  keywords = {}