This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Real-time Pointing Gesture Recognition for an Immersive Environment

R. Kehl and L. Van Gool
Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition
Seoul, South-Corea, May 2004


We present an algorithm for the real-time detection and interpretation of pointing gestures, performed with one or both arms. The pointing gestures are used as an intuitive tracking interface for a user interacting with an immersive virtual environment. We have defined the pointing direction to correspond to the line of sight connecting the eyes and the pointing fingertip. If a pointing gesture is being performed, the algorithm detects and tracks the position of the user's eyes and fingertip and computes the origin and direction of that gesture with respect to a real-world coordinate system. The algorithm is based on the body silhouettes extracted from multiple views and uses point correspondences to reconstruct in 3D the points of interest. The system doesn't require initial poses, special clothing, or markers.

Download in pdf format
  author = {R. Kehl and L. Van Gool},
  title = {Real-time Pointing Gesture Recognition for an Immersive Environment},
  booktitle = {Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition},
  year = {2004},
  month = {May},
  pages = {577-582},
  keywords = {gesture recognition, pointing gesture, real-time gesture recognition}