Publications
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.
Search for Publication
Recognition of gestures in the context of speech
M. Bray, H. Sidenbladh and J.O. Eklundh
International Conference on Pattern Recognition (ICPR02)
Quebec City, August 2002
Abstract
The scope of this paper is the interpretation of a user's intention via
a
video camera and a speech recognizer. In comparison to previous work
which only takes into account gesture recognition, we demonstrate that
by including speech, system comprehension increases. For the gesture
recognition, the user must wear a colored glove, then we extract the
derivative of the center of gravity of the hand. A Hidden Markov Model
(HMM) is learned for each gesture that we want to recognize. In a
dynamic action, to know if a gesture has been performed or not, we
implement a threshold model below which the gesture is not detected. The
off line test for gesture recognition have a success rate exceeding 85%
for each gesture. The combination of speech and gestures is realized
using Bayesian theory.
Download in pdf format
@InProceedings{eth_biwi_00251,
author = {M. Bray and H. Sidenbladh and J.O. Eklundh},
title = {Recognition of gestures in the context of speech},
booktitle = {International Conference on Pattern Recognition (ICPR02)},
year = {2002},
month = {August},
keywords = {hidden markov model, gesture recognition, speech integration}
}