This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Learning Domain Knowledge for Facade Labeling

D. Dai and M. Prasad and G. Schmitt and L. Van Gool


This paper presents an approach to address the problem of image facade labeling. In the architectural literature, domain knowledge is usually expressed geometrically in the final design, so facade labeling should on the one hand conform to visual evidence, and on the other hand to the architectural principles --- how individual assets (e.g. doors, windows) interact with each other to form a facade as a whole. To this end, we first propose a recursive splitting method to segment facades into a bunch of tiles for semantic recognition. The segmentation improves the processing speed, guides visual recognition on suitable scales and renders the extraction of architectural principles easy. Given a set of segmented training facades with their label maps, we then identify a set of meta-features to capture both the visual evidence and the architectural principles. The features are used to train our facade labeling model. In the test stage, the features are extracted from segmented facades and the inferred label maps. The following three steps are iterated until the optimal labeling is reached: 1) proposing modifications to the current labeling; 2) extracting new features for the proposed labeling; 3) feeding the new features to the labeling model to decide whether to accept the modifications. In experiments, we evaluated our method on the ECP facade dataset and achieved higher precision than the state-of-the-art at both the pixel level and the structural level.

Download in pdf format
  author = {D. Dai and M. Prasad and G. Schmitt and L. Van Gool},
  title = {Learning Domain Knowledge for Facade Labeling},
  booktitle = {ECCV},
  year = {2012},
  keywords = {}