This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Moving Obstacle Detection in Highly Dynamic Scenes

A. Ess, B. Leibe, K. Schindler, L. Van Gool
IEEE International Conference on Robotics and Automation (ICRA’09)
Kobe, Japan 2009


In this paper, we address the problem of vision-based multi-person tracking in busy pedestrian zones using a stereo rig mounted on a mobile platform. Specifically, we are interested in the application of such a system for supporting path planning algorithms in the avoidance of dynamic obstacles. The complexity of the problem calls for an integrated solution, which extracts as much visual information as possible and combines it through cognitive feedback. We propose such an approach, which jointly estimates camera position, stereo depth, object detections, and trajectories based on visual information only. We represent the interplay between these components using a graphical model. For each frame, we first estimate the ground surface together with a set of object detections. Conditioned on these results, we then address object interactions and estimate trajectories. Finally, we employ the tracking results to predict future motion for dynamic objects and fuse this information with a static occupancy map estimated from stereo. The approach is experimentally evaluated on several long and challenging video sequences from busy inner-city locations recorded with different mobile setups. Our results show that the proposed integration makes it possible to deliver stable tracking and motion prediction performance in complex and highly dynamic scenes.

Link to publisher's page
  author = {A. Ess and B. Leibe and K. Schindler and L. Van Gool},
  title = {Moving Obstacle Detection in Highly Dynamic Scenes},
  booktitle = {IEEE International Conference on Robotics and Automation (ICRA’09)},
  year = {2009},
  keywords = {}