This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Discovery of Sets of Mutually Orthogonal Vanishing Points in Videos

Till Kroeger and Dengxin Dai and Radu Timofte and Luc Van Gool
WACV Workshop - Benchmarking Multi-Target Tracking (BMTT)
January 2015


While vanishing point (VP) estimation has received extensive attention, most approaches focus on static images or perform detection and tracking separately. In this paper, we focus on man-made environments and propose a novel method for detecting and tracking groups of mutually orthogonal vanishing points (MOVP), also known as Manhattan frames, jointly from monocular videos. The method is unique in that it is designed to enforce orthogonality in groups of VPs, temporal consistency of each individual MOVP, and orientation consistency of all putative MOVP. To this end, the method consists of three steps: 1) proposal of MOVP candidates by directly incorporating mutual orthogonality; 2) extracting consistent tracks of MOVPs by minimizing the flow cost over a network where nodes are putative MOVPs and edges are putative links across time; and 3) refinement of all MOVPs by enforcing consistency between lines, their identified vanishing directions and consistency of global camera orientation. The method is evaluated on six newly collected and annotated videos of urban scenes. Extensive experiments show that the method outperforms greedy MOVP tracking method considerably. In addition, we also test the method for camera orientation estimation and show that it obtains very promising results on a challenging street-view dataset.

Download in pdf format
  author = {Till Kroeger and Dengxin Dai and Radu Timofte and Luc Van Gool},
  title = {Discovery of Sets of Mutually Orthogonal Vanishing Points in Videos},
  booktitle = {WACV Workshop - Benchmarking Multi-Target Tracking (BMTT)},
  year = {2015},
  month = {January},
  keywords = {}