This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Integrating Recognition and Reconstruction for Cognitive Traffic Scene Analysis from a Moving Vehicle

B. Leibe, N. Cornelis, K. Cornelis, L. Van Gool
DAGM Annual Pattern Recognition Symposium
Berlin, September 2006


This paper presents a practical system for vision-based traffic scene analysis from a moving vehicle based on a cognitive feedback loop which integrates real-time geometry estimation with appearance-based object detection. We demonstrate how those two components can benefit from each other's continuous input and how the transferred knowledge can be used to improve scene analysis. Thus, scene interpretation is not left as a matter of logical reasoning, but is instead addressed by the repeated interaction and consistency checks between different levels and modes of visual processing. As our results show, the proposed tight integration significantly increases recognition performance, as well as overall system robustness. In addition, it enables the construction of novel capabilities such as the accurate 3D estimation of object locations and orientations and their temporal integration in a world coordinate frame. The system is evaluated on a challenging real-world car detection task in an urban scenario.

Download in pdf format
  author = {B. Leibe and N. Cornelis and K. Cornelis and L. Van Gool},
  title = {Integrating Recognition and Reconstruction for Cognitive Traffic Scene Analysis from a Moving Vehicle},
  booktitle = {DAGM Annual Pattern Recognition Symposium},
  year = {2006},
  month = {September},
  pages = {192-201},
  volume = {4174},
  series = {LNCS},
  publisher = {Springer},
  keywords = {}