This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

A Three-Layered Approach to Facade Parsing

A. Martinovic, M. Mathias, J. Weissenberg and L. Van Gool


We propose a novel three-layered approach for semantic segmentation of building facades. In the first layer, starting from an over-segmentation of a facade, we employ the recently introduced machinelearning technique Recursive Neural Networks (RNN) to obtain a probabilistic interpretation of each segment. In the middle layer, initial labeling is augmented with the information coming from specialized facade component detectors. The information is merged using a Markov Random Field defined over the image. In the highest layer, we introduce weak architectural knowledge, which enforces the final reconstruction to be architecturally plausible and consistent. Rigorous tests performed on two existing datasets of building facades demonstrate that we significantly outperform the current-state of the art, even when using outputs from lower layers of the pipeline. In the end, we show how the output of the highest layer can be used to create a procedural reconstruction.

Download in pdf format
  author = {A. Martinovic and M. Mathias and J. Weissenberg and L. Van Gool},
  title = {A Three-Layered Approach to Facade Parsing},
  booktitle = {ECCV},
  year = {2012},
  keywords = {}