This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks

K.K. Maninis, J. Pont-Tuset, P. Arbeláez, L. Van Gool


We present Convolutional Oriented Boundaries (COB), which produces multiscale oriented contours and region hierarchies starting from generic image classification Convolutional Neural Networks (CNNs). COB is computationally efficient, because it requires a single CNN forward pass for multi-scale contour detection and it uses a novel sparse boundary representation for hierarchical segmentation; it gives a significant leap in performance over the state-of-the-art, and it generalizes very well to unseen categories and datasets. Particularly, we show that learning to estimate not only contour strength but also orientation provides more accurate results. We perform extensive experiments for low-level applications on BSDS, PASCAL Context, PASCAL Segmentation, and NYUD to evaluate boundary detection performance, showing that COB provides state-of-the-art contours and region hierarchies in all datasets. We also evaluate COB on high-level tasks when coupled with multiple pipelines for object proposals, semantic contours, semantic segmentation, and object detection on MS-COCO, SBD, and PASCAL; showing that COB also improves the results for all tasks.

Download in pdf format
  author = {K.K. Maninis and J. Pont-Tuset and P. Arbeláez and L. Van Gool},
  title = {Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks},
  journal = {IEEE TPAMI},
  year = {2017},
  month = {},
  pages = {},
  volume = {},
  number = {},
  keywords = {Contour detection, contour orientation, hierarchical image segmentation, object proposals, semantic contours}