Minimal solutions for pose estimation of a multi-camera system

Gim Hee Lee*, Bo Li, Marc Pollefeys, Friedrich Fraundorfer

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a novel formulation to solve the pose estimation problem of a calibrated multi-camera system. The non-central rays that pass through the 3D world points and multi-camera system are elegantly represented as Plücker lines. This allows us to solve for the depth of the points along the Plücker lines with a minimal set of 3-point correspondences. We show that the minimal solution for the depth of the points along the Plücker lines is an 8 degree polynomial that gives up to 8 real solutions. The coordinates of the 3D world points in the multi-camera frame are computed from the known depths. Consequently, the pose of the multi-camera system, i.e. the rigid transformation between the world and multi-camera frames can be obtained from absolute orientation. We also derive a closed-form minimal solution for the absolute orientation. This removes the need for the computationally expensive Singular Value Decompositions (SVD) during the evaluations of the possible solutions for the depths. We identify the correct solution and do robust estimation with RANSAC. Finally, the solution is further refined by including all the inlier correspondences in a non-linear refinement step. We verify our approach by showing comparisons with other existing approaches and results from large-scale real-world datasets.

Original languageEnglish
Title of host publicationSpringer Tracts in Advanced Robotics
PublisherSpringer Verlag
Pages521-538
Number of pages18
Volume114
ISBN (Print)9783319288703
DOIs
Publication statusPublished - 2016
Event16th International Symposium of Robotics Research, ISRR 2013 - Singapore, Singapore
Duration: 16 Dec 201319 Dec 2013

Publication series

NameSpringer Tracts in Advanced Robotics
Volume114
ISSN (Print)16107438
ISSN (Electronic)1610742X

Conference

Conference16th International Symposium of Robotics Research, ISRR 2013
CountrySingapore
CitySingapore
Period16/12/1319/12/13

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Minimal solutions for pose estimation of a multi-camera system'. Together they form a unique fingerprint.

Cite this