This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Supervised Evaluation of Image Segmentation and Object Proposal Techniques

J. Pont-Tuset and F. Marques
Vol. 38, No. 7, pp. 1465-1478, 2016


This paper tackles the supervised evaluation of image segmentation and object proposal algorithms. It surveys, structures, and deduplicates the measures used to compare both segmentation results and object proposals with a ground truth database; and proposes a new measure: the precision-recall for objects and parts. To compare the quality of these measures, eight state-of-the-art object proposal techniques are analyzed and two quantitative meta-measures involving nine state of the art segmentation methods are presented. The meta-measures consist in assuming some plausible hypotheses about the results and assessing how well each measure reflects these hypotheses. As a conclusion of the performed experiments, this paper proposes the tandem of precision-recall curves for boundaries and for objects-and-parts as the tool of choice for the supervised evaluation of image segmentation. We make the datasets and code of all the measures publicly available.

Link to publisher's page
  author = {J. Pont-Tuset and F. Marques},
  title = {Supervised Evaluation of Image Segmentation and Object Proposal Techniques},
  journal = {IEEE TPAMI},
  year = {2016},
  month = {},
  pages = {1465-1478},
  volume = {38},
  number = {7},
  keywords = {}