This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

I know what you did last summer: object-level auto-annotation of holiday snaps

S. Gammeter, L. Bossard, T. Quack, L. Van Gool
International Conference on Computer Vision (ICCV 2009)
October 2009


The state-of-the art in visual object retrieval from large databases allows to search millions of images on the object level. Recently, complementary works have proposed systems to crawl large object databases from community photo collections on the Internet. We combine these two lines of work to a large-scale system for auto-annotation of holiday snaps. The resulting method allows for automatic labeling objects such as landmark buildings, scenes, pieces of art etc. at the object level in a fully automatic manner. The labeling is multi-modal and consists of textual tags, geographic location, and related content on the Internet. Furthermore, the efficiency of the retrieval process is optimized by creating more compact and precise indices for visual vocabularies using background information obtained in the crawling stage of the system. We demonstrate the scalability and precision of the proposed method by conducting experiments on millions of images downloaded from community photo collections on the Internet.

Download in pdf format
  author = {S. Gammeter and L. Bossard and T. Quack and L. Van Gool},
  title = {I know what you did last summer: object-level auto-annotation of holiday snaps},
  booktitle = {International Conference on Computer Vision (ICCV 2009)},
  year = {2009},
  month = {October},
  pages = {8},
  keywords = {auto annotation, large scale image retrieval}