This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

From Speech to 3D face animation

P. Vanroose, G. A. Kalberer, P. Wambacq and L. Van Gool
Procs. of the Benelux Symposium on Information Theory


In this paper we present a new method to animate the face of a speaking avatar |i.e., a synthetic 3D human face| such that it re- alistically pronounces any given text, based on the audio only. Especially the lip movements must be rendered carefully, and perfectly synchronised with the audio, in order to have a realistic looking result, from which it should in principle be possible to understand the pronounced sentence by lip reading. Since such a system requires minimal bandwidth and relatively low com- putational e ort, it could e.g. be used to transmit video conferencing data over a very low bandwidth channel, where the lip motion rendering is done at the receiving end, by only transmitting the audio channel, or in extremis even only an orthographic or phonetic transcription of the text together with precise phoneme timing information.

Download in pdf format
  author = {P. Vanroose and G. A. Kalberer and P. Wambacq and L. Van Gool},
  title = {From Speech to 3D face animation},
  booktitle = {Procs. of the Benelux Symposium on Information Theory},
  year = {2002},
  keywords = {face, animation, 3D, speech}