This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Random Forests for Real Time 3D Face Analysis

G. Fanelli, M. Dantone, J. Gall, A. Fossati and L. Van Gool
International Journal of Computer Vision
August 2012


We present a random forest-based framework for real time head pose estimation from depth images and extend it to localize a set of facial features in 3D. Our algorithm takes a voting approach, where each patch extracted from the depth image can directly cast a vote for the head pose or each of the facial features. Our system proves capable of handling large rotations, partial occlusions, and the noisy depth data acquired using commercial sensors. Moreover, the algorithm works on each frame independently and achieves real time performance without resorting to parallel computations on a GPU. We present extensive experiments on publicly available, challenging datasets and present a new annotated head pose database recorded using a Microsoft Kinect.

Download in pdf format
  author = {G. Fanelli and M. Dantone and J. Gall and A. Fossati and L. Van Gool},
  title = {Random Forests for Real Time 3D Face Analysis},
  journal = {International Journal of Computer Vision},
  year = {2012},
  month = {August},
  pages = {},
  volume = {},
  number = {},
  keywords = {Random forests; Head pose estimation; 3D facial features detection; Real time}