General 3D Room Layout from a Single View by Render-and-Compare

Sinisa Stekovic*, Shreyas Hampali Shivakumar, Mahdi Rad, Sayan Deb Sarkar, Friedrich Fraundorfer, Vincent Lepetit

*Korrespondierende/r Autor/in für diese Arbeit

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem Konferenzband

Abstract

We present a novel method to reconstruct the 3D layout of a room—walls, floors, ceilings—from a single perspective view in challenging conditions, by contrast with previous single-view methods restricted to cuboid-shaped layouts. This input view can consist of a color image only, but considering a depth map results in a more accurate reconstruction. Our approach is formalized as solving a constrained discrete optimization problem to find the set of 3D polygons that constitute the layout. In order to deal with occlusions between components of the layout, which is a problem ignored by previous works, we introduce an analysis-by-synthesis method to iteratively refine the 3D layout estimate. As no dataset was available to evaluate our method quantitatively, we created one together with several appropriate metrics. Our dataset consists of 293 images from ScanNet, which we annotated with precise 3D layouts. It offers three times more samples than the popular NYUv2 303 benchmark, and a much larger variety of layouts.

Originalspracheenglisch
TitelComputer Vision – ECCV 2020 - 16th European Conference, Proceedings
Redakteure/-innenAndrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm
Herausgeber (Verlag)Springer, Cham
Seiten187-203
Seitenumfang17
ISBN (Print)9783030585167
DOIs
PublikationsstatusVeröffentlicht - 23 Aug 2020
Veranstaltung16th European Conference on Computer Vision: ECCV 2020 - Virtual, Glasgow, Großbritannien / Vereinigtes Königreich
Dauer: 23 Aug 202028 Aug 2020

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band12361 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Konferenz

Konferenz16th European Conference on Computer Vision
KurztitelECCV 2020
LandGroßbritannien / Vereinigtes Königreich
OrtVirtual, Glasgow
Zeitraum23/08/2028/08/20

ASJC Scopus subject areas

  • !!Theoretical Computer Science
  • !!Computer Science(all)

Fingerprint

Untersuchen Sie die Forschungsthemen von „General 3D Room Layout from a Single View by Render-and-Compare“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren