This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Speech Animation using Viseme Space

G. A. Kalberer, P. Mueller and L. Van Gool
Vision, Modeling, and Visualization VMV 2002
Erlangen, Germany 2002


A method for realistic face animation is proposed. In particular it focuses on speech animation. When asked to animate a face it replicates the 3D 'visemes' that it has learned from talking actors, and adds the necessary coarticulation effects. The speech animation could be based on as few as 16 modes, extracted through Independent Component Analysis from different face dynamics. The exact deformation fields that come with the different visemes are adapted by the system to take the shape of the given face into account. By localising the face to be animated in a face space, where also the locations of the neutral example faces are known, visemes are adapted automatically according to the relative distance with respect to these examples.

Download in pdf format
  author = {G. A. Kalberer and P. Mueller and L. Van Gool},
  title = {Speech Animation using Viseme Space},
  booktitle = {Vision, Modeling, and Visualization VMV 2002},
  year = {2002},
  pages = {463-470},
  publisher = {Akademische Verlagsgesellschaft Aka GmbH, Berlin},
  keywords = {face animation, ICA, PCA, visemes, realism, dynamic space, physionomically adapted visemes, generating visemes}