This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Measuring the objectness of image windows

Bogdan Alexe, Thomas Deselaers, Vittorio Ferrari
IEEE Transactions on Pattern Analysis and Machine Intelligence
Vol. 34, No. 11, pp. 2189-2202, November 2012


We present a generic objectness measure, quantifying how likely it is for an image window to contain an object of any class. We explicitly train it to distinguish objects with a well-deÞned boundary in space, such as cows and telephones, from amorphous background elements, such as grass and road. The measure combines in a Bayesian framework several image cues measuring characteristics of objects, such as appearing different from their surroundings and having a closed boundary. These include an innovative cue to measure the closed boundary characteristic. In experiments on the challenging PASCAL VOC 07 dataset, we show this new cue to outperform a state-of-the-art saliency measure, and the combined objectness measure to perform better than any cue alone. We also compare to interest point operators, a HOG detector, and three recent works aiming at automatic object segmentation. Finally, we present two applications of objectness. In the Þrst, we sample a small number windows according to their objectness probability and give an algorithm to employ them as location priors for modern class-speciÞc object detectors. As we show experimentally, this greatly reduces the number of windows evaluated by the expensive class-speciÞc model. In the second application, we use objectness as a complementary score in addition to the class-speciÞc model, which leads to fewer false positives. As shown in several recent papers, objectness can act as a valuable focus of attention mechanism in many other applications operating on image windows, including weakly supervised learning of object categories, unsupervised pixelwise segmentation, and object tracking in video. Computing objectness is very efÞcient and takes only about 4 sec. per image.

Link to publisher's page
Download in pdf format
  author = {Bogdan Alexe and Thomas Deselaers and Vittorio Ferrari},
  title = {Measuring the objectness of image windows},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2012},
  month = {November},
  pages = {2189-2202},
  volume = {34},
  number = {11},
  keywords = {objectness measure, object detection, object recognition}