This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Augmented Faces

M. Dantone, L. Bossard, T. Quack, L. Van Gool
IEEE International Workshop on Mobile Vision (ICCV 2011)


In this paper we present a fully automatic system for face augmentation on mobile devices. A user can point his mo- bile phone to a person and the system recognizes his or her face. A tracking algorithm overlays information about the identified person on the screen, thereby achieving an aug- mented reality effect. The tracker is running on the mobile client, while the recognition is running on a server. The database on the server is built by a fully autonomous crawl- ing method, which taps social networks. For this work we collected 300 000 images from Facebook. The social con- text gained during this social network analysis is also used to improve the face recognition. The complete system runs in real time on a state-of-the-art mobile phone and is fully automatic, from offline crawling up to augmentation on the mobile device. It can be used to display more information about the identified persons or as a user interface for mixed reality application. To the best of our knowledge this is the first work, which covers such a system end-to-end.

Download in pdf format
  author = {M. Dantone and L. Bossard and T. Quack and L. Van Gool},
  title = {Augmented Faces},
  booktitle = {IEEE International Workshop on Mobile Vision (ICCV 2011)},
  year = {2011},
  keywords = {Augmented Faces, Face Recognition, Face Tracking, Facebook, Social Networks}