This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Towards On-Line Digital Doubles

Andreas Griesser, Nico Cornelis and Luc Van Gool
Proc. of the 3rd Intl. Symp. on 3D Data Processing, Visualization and Transmission (3DPVT)
June 2006


We present a modular system for real-time 3D-scanning of human bodies under motion. The high-resolution shape and colour appearance is captured by several scanning units positioned around the object of interest. Each of these units performs a foreground-background segmentation and computes a valid depth-range for the spatially neighbouring units. Multiple depth-ranges are combined in a visual hull representation, which limits the search-range for the 3D-reconstruction. Depth-estimation is based on a hierarchical mult-view-stereo plane sweep approach. Robustness and accuracy is increased by incorporating imperceptible infrared illumination as well as adding local pixel gradient information. All parts of the processing pipeline, involving camera color conversions, segmentation, depth-range computation, visual-hull generation, lossless image compression, network transfer of the infrared and colour images, and the plane sweep algorithm, are implemented on the GPU and highly optimized for speed, allowing scanning times of less than 40ms per frame. Experimental results demonstrate the applicability of our system to the creation of high-density on-line digital doubles.

Download in pdf format
  author = {Andreas Griesser and Nico Cornelis and Luc Van Gool},
  title = {Towards On-Line Digital Doubles},
  booktitle = {Proc. of the 3rd Intl. Symp. on 3D Data Processing, Visualization and Transmission (3DPVT)},
  year = {2006},
  month = {June},
  keywords = {online digital doubles realtime 3d scan visual hull plane sweep}