Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

Recognition of gestures in the context of speech

M. Bray, H. Sidenbladh and J.O. Eklundh
International Conference on Pattern Recognition (ICPR02)
Quebec City, August 2002

Abstract

The scope of this paper is the interpretation of a user's intention via a video camera and a speech recognizer. In comparison to previous work which only takes into account gesture recognition, we demonstrate that by including speech, system comprehension increases. For the gesture recognition, the user must wear a colored glove, then we extract the derivative of the center of gravity of the hand. A Hidden Markov Model (HMM) is learned for each gesture that we want to recognize. In a dynamic action, to know if a gesture has been performed or not, we implement a threshold model below which the gesture is not detected. The off line test for gesture recognition have a success rate exceeding 85% for each gesture. The combination of speech and gestures is realized using Bayesian theory.

Download in pdf format
@InProceedings{eth_biwi_00251,
  author = {M. Bray and H. Sidenbladh and J.O. Eklundh},
  title = {Recognition of gestures in the context of speech},
  booktitle = {International Conference on Pattern Recognition (ICPR02)},
  year = {2002},
  month = {August},
  keywords = {hidden markov model, gesture recognition, speech integration}
}