IB-MVS: An Iterative Algorithm for Deep Multi-View Stereo based on Binary Decisions

Christian Sormann*, Mattia Rossi, Andreas Kuhn, Friedrich Fraundorfer

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Abstract

We present a novel deep-learning-based method for Multi-View Stereo. Our method estimates high resolution and highly precise depth maps iteratively, by traversing the continuous space of feasible depth values at each pixel in a binary decision fashion. The decision process leverages a deep-network architecture: this computes a pixelwise binary mask that establishes whether each pixel actual depth is in front or behind its current iteration individual depth hypothesis. Moreover, in order to handle occluded regions, at each iteration the results from different source images are fused using pixelwise weights estimated by a second network. Thanks to the adopted binary decision strategy, which permits an efficient exploration of the depth space, our method can handle high resolution images without trading resolution and precision. This sets it apart from most alternative learning-based Multi-View Stereo methods, where the explicit discretization of the depth space requires the processing of large cost volumes. We compare our method with state-of-the-art Multi-View Stereo methods on the DTU, Tanks and Temples and the challenging ETH3D benchmarks and show competitive results.
Original languageEnglish
Title of host publicationBritish Machine Vision Conference (BMVC) 2021
PublisherThe British Machine Vision Association
Number of pages13
Publication statusPublished - 22 Nov 2021
Event32nd British Machine Vision Conference: BMVC 2021 - Virtuell, United Kingdom
Duration: 22 Nov 202125 Nov 2021

Conference

Conference32nd British Machine Vision Conference
Abbreviated titleBMVC 2021
Country/TerritoryUnited Kingdom
CityVirtuell
Period22/11/2125/11/21

Fingerprint

Dive into the research topics of 'IB-MVS: An Iterative Algorithm for Deep Multi-View Stereo based on Binary Decisions'. Together they form a unique fingerprint.

Cite this