Learning Densities in Feature Space for Reliable Segmentation of Indoor Scenes
- Working Paper
Deep learning has enabled remarkable advances in scene understanding, particularly in semantic segmentation tasks. Yet, current state of the art approaches are limited to a closed set of classes, and fail when facing novel elements, also known as out of distribution (OoD) data. This is a problem as autonomous agents will inevitably come across a wide range of objects, all of which cannot be included during training. We propose a novel method to distinguish any object (foreground) from empty building structure (background) in indoor environments. We use normalizing flow to estimate the probability distribution of high-dimensional background descriptors. Foreground objects are therefore detected as areas in an image for which the descriptors are unlikely given the background distribution. As our method does not explicitly learn the representation of individual objects, its performance generalizes well outside of the training examples. Our model results in an innovative solution to reliably segment foreground from background in indoor scenes, which open s the way to a safer deployment of robots in human environments. Show more
Journal / seriesarXiv
Pages / Article No.
SubjectDeep Learning in Robotics and Automation; Semantic scene understanding; Visual learning
Organisational unit03737 - Siegwart, Roland Y. / Siegwart, Roland Y.
03737 - Siegwart, Roland Y. / Siegwart, Roland Y.
NotesSubmitted on 1 August 2019 (v1), last revised 23 September 2019 (v2).
MoreShow all metadata