This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Face/Off: Live Facial Puppetry

T. Weise, H. Li, L. Van Gool, and M. Pauly
Symposium on Computer Animation
August 2009, in press


We present a complete integrated system for live facial puppetry that enables high-resolution real-time facial expression tracking with transfer to another person's face. The system utilizes a real-time structured light scanner that provides dense 3D data and texture. A generic template mesh, fitted to a rigid reconstruction of the actor?s face, is tracked offline in a training stage through a set of expression sequences. These sequences are used to build a person-specific linear face model that is subsequently used for online face tracking and expression transfer. Even with just a single rigid pose of the target face, convincing real-time facial animations are achievable. The actor becomes a puppeteer with complete and accurate control over a digital face.

  author = {T. Weise and H. Li and L. Van Gool and and M. Pauly},
  title = {Face/Off: Live Facial Puppetry},
  booktitle = {Symposium on Computer Animation},
  year = {2009},
  month = {August},
  keywords = {},
  note = {in press}