Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

Server-side object recognition and client-side object tracking for mobile augmented reality

S. Gammeter and A. Gassmann and L. Bossard and T. Quack and L. Van Gool
IEEE International Workshop on Mobile Vision (CVPR 2010)
June 2010

Abstract

In this paper we present a system for mobile augmented reality (AR) based on visual recognition. We split the tasks of recognizing an object and tracking it on the user’s screen into a server-side and a client-side task, respectively. The capabilities of this hybrid client-server approach are demonstrated with a prototype application on the Android platform, which is able to augment both stationary (landmarks) and non stationary (media covers) objects. The database on the server side consists of hundreds of thousands of landmarks, which is crawled using a state of the art mining method for community photo collections. In addition to the landmark images, we also integrate a database of media covers with millions of items. Retrieval from these databases is done using vocabularies of local visual features. In order to fulfill the real-time constraints for AR applications, we introduce a method to speed-up geometric verification of feature matches. The client-side tracking of recognized objects builds on a multi-modal combination of visual features and sensor measurements. Here, we also introduce a motion estimation method, which is more efficient and precise than similar approaches. To the best of our knowledge this is the first system, which demonstrates a complete pipeline for augmented reality on mobile devices with visual object recognition scaled to millions of objects combined with real-time object tracking.


Download in pdf format
@InProceedings{eth_biwi_00782,
  author = {S. Gammeter and A. Gassmann and L. Bossard and T. Quack and L. Van Gool},
  title = {Server-side object recognition and client-side object tracking for mobile augmented reality},
  booktitle = {IEEE International Workshop on Mobile Vision (CVPR 2010)},
  year = {2010},
  month = {June},
  keywords = {}
}