Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

World-scale mining of objects and events from community photo collections

T. Quack and Bastian Leibe and Luc Van Gool
Conference on Image and Video Retrieval (CIVR
July 2008

Abstract

In this paper, we describe an approach for mining images of objects (such as touristic sights) from community photo collections in an unsupervised fashion. Our approach relies on retrieving geotagged photos from those web-sites using a grid of geospatial tiles. The downloaded photos are clustered into potentially interesting entities through a processing pipeline of several modalities, including visual, textual and spatial proximity. The resulting clusters are analyzed and are automatically classified into objects and events. Using mining techniques, we then find text labels for these clusters, which are used to again assign each cluster to a corresponding Wikipedia article in a fully unsupervised manner. A final verification step uses the contents (including images) from the selected Wikipedia article to verify the cluster-article assignment. We demonstrate this approach on several urban areas, densely covering an area of over 700 square kilometers and mining over 200,000 photos, making it probably the largest experiment of its kind to date.


Download in pdf format
@InProceedings{eth_biwi_00557,
  author = {T. Quack and Bastian Leibe and Luc Van Gool},
  title = {World-scale mining of objects and events from community photo collections},
  booktitle = {Conference on Image and Video Retrieval (CIVR},
  year = {2008},
  month = {July},
  publisher = {ACM},
  keywords = {}
}