This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Computer Vision-Based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks

T. Starner, B. Leibe, D. Minnen, T. Westyn, A. Hurst, and J. Weeks
Machine Vision and Applications
Vol. 14, No. 1, pp. 59-71, April 2003


The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3D shape can be captured and inserted into the virtual interface. This ability permits spontaneity since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.

Download in pdf format
  author = {T. Starner and B. Leibe and D. Minnen and T. Westyn and A. Hurst and and J. Weeks},
  title = { Computer Vision-Based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks},
  journal = {Machine Vision and Applications},
  year = {2003},
  month = {April},
  pages = {59-71},
  volume = {14},
  number = {1},
  keywords = {}