A Deep Learning Pipeline for Semantic Facade Segmentation


We propose an algorithm that provides a pixel-wise classification of building facades. Building facades provide a rich environment for testing semantic segmentation techniques. They come in a variety of styles that reflect both appearance and layout characteristics. On the other hand, they exhibit a degree of stability in the arrangement of structures across different instances. We integrate appearance and layout cues in a single framework. The most likely label based on appearance is obtained through applying the state-of-the-art deep convolution networks. This is further optimized through Restricted Boltzmann Machines (RBM), applied on vertical and horizontal scanlines of facade models. Learning the probability distributions of the models via the RBMs is utilized in two settings. Firstly, we use them in learning from pre-seen facade samples, in the traditional training sense. Secondly, we learn from the test image at hand, in a way the allows the transfer of visual knowledge of the scene from correctly classified areas to others. Experimentally, we are on par with the reported performance results. However, we do not explicitly specify any hand-engineered features that are architectural scene dependent, nor do we include any dataset specific heuristics/thresholds.

Divisions: College of Engineering & Physical Sciences > School of Informatics and Digital Engineering > Computer Science
College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
Additional Information: c 2017. The copyright of this document resides with its authors. It may be distributed unchanged freely in print or electronic forms.
Event Title: British Machine Vision Conference
Event Type: Other
Event Dates: 2017-09-10
PURE Output Type: Conference contribution
Published Date: 2017-09-30
Accepted Date: 2017-09-10
Authors: Fathalla, Radwa
Vogiatzis, George (ORCID Profile 0000-0002-3226-0603)



Version: Published Version

| Preview

Export / Share Citation


Additional statistics for this record