This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

PICASO: PIxel Correspondences And SOft Match Selection for Real-time Tracking

Radu Timofte and Junseok Kwon and Luc Van Gool
Computer Vision and Image Understanding (CVIU 2016)
February 2016


Visual tracking is one of the computer vision’s longstanding challenges, with many methods as a result. While most state-of-the-art methods trade-off performance for speed, we propose PICASO, an efficient, yet strongly performing tracking scheme. The target object is modeled as a set of pixel-level templates with weak configuration constraints. The pixels of a search window are matched against those of the surrounding context and of the object model. To increase the robustness, we match also from the object to the search window, and the pairs matching in both directions are the correspondences used to localize. This localization process is robust, also against occlusions which are explicitly modeled. Another source of robustness is that the model - as in several other modern trackers - gets constantly updated over time with newly incoming information about the target appearance. Each pixel is described by its local neighborhood. The match of a pixel is taken to be the one with the largest contribution in its sparse decomposition over a set of pixels. For this soft match selection, we analyze both l1 and l2 -regularized least squares formulations and the recently proposed l1 -constrained ‘Iterative Nearest Neighbors’ approach. We evaluate our tracker on standard videos for rigid and non-rigid object tracking. We obtain excellent performance at 42fps with Matlab on a CPU.

Download in pdf format
  author = {Radu Timofte and Junseok Kwon and Luc Van Gool},
  title = {PICASO: PIxel Correspondences And SOft Match Selection for Real-time Tracking},
  journal = {Computer Vision and Image Understanding (CVIU 2016)},
  year = {2016},
  month = {February},
  pages = {},
  volume = {},
  number = {},
  keywords = {}