This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Markerless Motion Capture with Unsynchronized Moving Cameras

N. Hasler, B. Rosenhahn, T. Thormählen, M. Wand, J. Gall and H.-P. Seidel
IEEE Conference on Computer Vision and Pattern Recognition


In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.

Download in pdf format
  author = {N. Hasler and B. Rosenhahn and T. Thorm\"ahlen and M. Wand and J. Gall and H.-P. Seidel},
  title = {Markerless Motion Capture with Unsynchronized Moving Cameras},
  booktitle = {IEEE Conference on Computer Vision and Pattern Recognition},
  year = {2009},
  keywords = {}