Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

SparseFlow: Sparse Matching for Small to Large Displacement Optical Flow

Radu Timofte and Luc Van Gool
IEEE Winter Conference on Applications of Computer Vision (WACV 2015)
January 2015

Abstract

Despite recent advances, the extraction of optical flow with large displacements is still challenging for state-of-the-art methods. The approaches that are the most successful at handling large displacements blend sparse correspondences from a matching algorithm with an optimization that refines the optical flow. We follow the scheme of DeepFlow [33]. We first extract sparse pixel correspondences by means of a matching procedure and then apply a variational approach to obtain a refined optical flow. In our approach, coined ‘SparseFlow’, the novelty lies in the matching. This uses an efficient sparse decomposition of a pixel’s surrounding patch as a linear sum of those found around candidate corresponding pixels. As matching pixel the one dominating the decomposition is chosen. The pixel pairs matching in both directions, i.e. in a forward-backward fashion, are used as guiding points in the variational approach. SparseFlow is competitive on standard optical flow benchmarks with large displacements, while showing excellent performance for small and medium displacements. Moreover, it is fast in comparison to methods with a similar performance.


Download in pdf format
@InProceedings{eth_biwi_01166,
  author = {Radu Timofte and Luc Van Gool},
  title = {SparseFlow: Sparse Matching for Small to Large Displacement Optical Flow},
  booktitle = {IEEE Winter Conference on Applications of Computer Vision (WACV 2015)},
  year = {2015},
  month = {January},
  keywords = {}
}