SceneNet: Understanding Real World Indoor Scenes With Synthetic Data


Type
Conference Object
Change log
Authors
Handa, Ankur 
Patraucean, Viorica 
Badrinarayanan, Vijay 
Stent, Simon 
Abstract

Scene understanding is a prerequisite to many high level tasks for any automated intelligent machine operating in real world environments. Recent attempts with supervised learning have shown promise in this direction but also highlighted the need for enormous quantity of supervised data --- performance increases in proportion to the amount of data used. However, this quickly becomes prohibitive when considering the manual labour needed to collect such data. In this work, we focus our attention on depth based semantic per-pixel labelling as a scene understanding problem and show the potential of computer graphics to generate virtually unlimited labelled data from synthetic 3D scenes. By carefully synthesizing training data with appropriate noise models we show comparable performance to state-of-the-art RGBD systems on NYUv2 dataset despite using only depth data as input and set a benchmark on depth-based segmentation on SUN RGB-D dataset. Additionally, we offer a route to generating synthesized frame or video data, and understanding of different factors influencing performance gains.

Description
Keywords
cs.CV, cs.CV
Journal Title
Conference Name
IEEE Conference on Computer Vision and Pattern Recognition
Journal ISSN
Volume Title
Publisher