Fast Approximate Energy Minimization via Graph Cuts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Mean Shift: A Robust Approach Toward Feature Space Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Metric Rectification for Perspective Images of Planes
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Modelling and Interpretation of Architecture from Several Images
International Journal of Computer Vision
Style Grammars for Interactive Visualization of Architecture
IEEE Transactions on Visualization and Computer Graphics
Image-based procedural modeling of facades
ACM SIGGRAPH 2007 papers
ACM SIGGRAPH Asia 2008 papers
Bottom-Up/Top-Down Image Parsing with Attribute Grammar
IEEE Transactions on Pattern Analysis and Machine Intelligence
Analysis of Building Textures for Reconstructing Partially Occluded Facades
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Image-based street-side city modeling
ACM SIGGRAPH Asia 2009 papers
A connection between partial symmetry and inverse procedural modeling
ACM SIGGRAPH 2010 papers
Unsupervised facade segmentation using repetitive patterns
Proceedings of the 32nd DAGM conference on Pattern recognition
Procedural 3D Building Reconstruction Using Shape Grammars and Detectors
3DIMPVT '11 Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission
Façade Segmentation in a Multi-view Scenario
3DIMPVT '11 Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission
Regionwise classification of building facade images
PIA'11 Proceedings of the 2011 ISPRS conference on Photogrammetric image analysis
Reconstruction of façade structures using a formal grammar and RjMCMC
DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Shape grammar parsing via Reinforcement Learning
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Pedestrian detection at 100 frames per second
CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Semantizing complex 3D scenes using constrained attribute grammars
SGP '13 Proceedings of the Eleventh Eurographics/ACMSIGGRAPH Symposium on Geometry Processing
| Hi-index | 0.00 |
We propose a novel three-layered approach for semantic segmentation of building facades. In the first layer, starting from an oversegmentation of a facade, we employ the recently introduced machine learning technique Recursive Neural Networks (RNN) to obtain a probabilistic interpretation of each segment. In the second layer, initial labeling is augmented with the information coming from specialized facade component detectors. The information is merged using a Markov Random Field. In the third layer, we introduce weak architectural knowledge, which enforces the final reconstruction to be architecturally plausible and consistent. Rigorous tests performed on two existing datasets of building facades demonstrate that we significantly outperform the current-state of the art, even when using outputs from earlier layers of the pipeline. Also, we show how the final output of the third layer can be used to create a procedural reconstruction.