This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Markerless tracking of complex human motions from multiple views

Roland Kehl and Luc Van Gool
Computer Vision and Image Understanding
Vol. 104, No. 2, pp. 190 - 209, November 2006


We present a method for markerless tracking of complex human motions from multiple camera views. In the absence of markers, the task of recovering the pose of a person during such motions is challenging and requires strong image features and robust tracking. We propose a solution which integrates multiple image cues such as edges, color information and volumetric reconstruction. We show that a combination of multiple image cues helps the tracker to overcome ambiguous situations such as limbs touching or strong occlusions of body parts. Following a model-based approach, we match an articulated body model built from superellipsoids against these image cues. Stochastic Meta Descent (SMD) optimization is used to find the pose which best matches the images. Stochastic sampling makes SMD robust against local minima and lowers the computational costs as a small set of predicted image features is sufficient for optimization. The power of SMD is demonstrated by comparing it to the commonly used Levenberg-Marquardt method. Results are shown for several challenging sequences showing complex motions and full articulation, with tracking of 24 degrees of freedom in approx. 1 frame per second.

Download in pdf format
  author = {Roland Kehl and Luc Van Gool},
  title = {Markerless tracking of complex human motions from multiple views},
  journal = {Computer Vision and Image Understanding},
  year = {2006},
  month = {November},
  pages = {190 - 209},
  volume = {104},
  number = {2},
  keywords = {Markerless tracking; Full body tracking; SMD; Multi-view tracking; Markerless motion capture; Multiple cues; Volumetric reconstruction}