This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Generating Visemes for Realistic Animation

G. A. Kalberer, P. Mueller and L. Van Gool
Vision, Modeling, and Visualization VMV 2002
Erlangen, Germany 2002


Efficient, realistic face animation is still a challenge. A system is proposed that yields realistic visemes for speech animation. This paper discusses the extraction of these visemes. It starts from real 3D face dynamics, observed at frame rate for thousands of points on the faces of speaking actors. A generic 3D mesh is fitted to the data throughout 3D time sequences. This is based on a combination of morphing and tracking techniques. The actual animation is the subject of a companion paper.

Download in pdf format
  author = {G. A. Kalberer and P. Mueller and L. Van Gool},
  title = {Generating Visemes for Realistic Animation},
  booktitle = {Vision, Modeling, and Visualization VMV 2002},
  year = {2002},
  pages = {233-240},
  publisher = {Akademische Verlagsgesellschaft Aka GmbH, Berlin},
  keywords = {face animation, ICA, PCA, visemes, realism, dynamic space, physionomically adapted visemes, generating visemes}