This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Video-based Reconstruction of Animatable Human Characters

C. Stoll and J. Gall and E. de Aguiar and S. Thrun and C. Theobalt
ACM Transactions on Graphics
Vol. 29, No. 6, 2010


We present a new performance capture approach that incorporates a physically-based cloth model to reconstruct a rigged fullyanimatable virtual double of a real person in loose apparel from multi-view video recordings. Our algorithm only requires a minimum of manual interaction. Without the use of optical markers in the scene, our algorithm first reconstructs skeleton motion and detailed time-varying surface geometry of a real person from a reference video sequence. These captured reference performance data are then analyzed to automatically identify non-rigidly deforming pieces of apparel on the animated geometry. For each piece of apparel, parameters of a physically-based real-time cloth simulation model are estimated, and surface geometry of occluded body regions is approximated. The reconstructed character model comprises a skeleton-based representation for the actual body parts and a physically-based simulation model for the apparel. In contrast to previous performance capture methods, we can now also create new real-time animations of actors captured in general apparel.

Download in pdf format
  author = {C. Stoll and J. Gall and E. de Aguiar and S. Thrun and C. Theobalt},
  title = {Video-based Reconstruction of Animatable Human Characters},
  journal = {ACM Transactions on Graphics},
  year = {2010},
  month = {},
  pages = {},
  volume = {29},
  number = {6},
  keywords = {}