This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Simultaneous Object Recognition and Segmentation from Single or Multiple Model Views

V. Ferrari, T. Tuytelaars, and L. Van Gool
International Journal of Computer Vision (IJCV)
Vol. 67, No. 2, pp. 159-188, 2006


We present a novel Object Recognition approach based on affine invariant regions. It actively counters the problems related to the limited repeatability of the region detectors, and the difficulty of matching, in the presence of large amounts of background clutter and particularly challenging viewing conditions. After producing an initial set of matches, the method gradually explores the surrounding image areas, recursively constructing more and more matching regions, increasingly farther from the initial ones. This process covers the object with matches, and simultaneously separates the correct matches from the wrong ones. Hence, recognition and segmentation are achieved at the same time. The approach includes a mechanism for capturing the relationships between multiple model views and exploiting these for integrating the contributions of the views at recognition time. This is based on an efficient algorithm for partitioning a set of region matches into groups lying on smooth surfaces. Integration is achieved by measuring the consistency of configurations of groups arising from different model views. Experimental results demonstrate the stronger power of the approach in dealing with extensive clutter, dominant occlusion, and large scale and viewpoint changes. Non-rigid deformations are explicitly taken into account, and the approximative contours of the object are produced. All presented techniques can extend any viewpoint invariant feature extractor.

Download in pdf format
  author = {V. Ferrari and T. Tuytelaars and and L. Van Gool},
  title = {Simultaneous Object Recognition and Segmentation from Single or Multiple Model Views},
  journal = {International Journal of Computer Vision (IJCV)},
  year = {2006},
  month = {},
  pages = {159-188},
  volume = {67},
  number = {2},
  keywords = {}