TY - JOUR
T1 - Omnidirectional camera pose estimation and projective texture mapping for photorealistic 3D virtual reality experiences
AU - Luchetti, Alessandro
AU - Zanetti, Matteo
AU - Kalkofen, Denis
AU - De Cecco, Mariolino
N1 - Funding Information:
Funding: This work was developed inside the European project MiReBooks: Mixed Reality Handbooks for Mining Education, a project funded by EIT Raw Materials.
Publisher Copyright:
© 2022 International Measurement Confederation (IMEKO). All rights reserved.
PY - 2022
Y1 - 2022
N2 - Modern applications in virtual reality require a high level of fruition of the environment as if it was real. In applications that have to deal with real scenarios, it is important to acquire both its three-dimensional (3D) structure and details to enable the users to achieve good immersive experiences. The purpose of this paper is to illustrate a method to obtain a mesh with high quality texture combining a raw 3D mesh model of the environment and 360° images. The main outcome is a mesh with a high level of photorealistic details. This enables both a good depth perception thanks to the mesh model and high visualization quality thanks to the 2D resolution of modern omnidirectional cameras. The fundamental step to reach this goal is the correct alignment between the 360° camera and the 3D mesh model. For this reason, we propose a method that embodies two steps: 1) find the 360° cameras pose within the current 3D environment; 2) project the high-quality 360° image on top of the mesh. After the method description, we outline its validation in two virtual reality scenarios, a mine and city environment, respectively, which allows us to compare the achieved results with the ground truth.
AB - Modern applications in virtual reality require a high level of fruition of the environment as if it was real. In applications that have to deal with real scenarios, it is important to acquire both its three-dimensional (3D) structure and details to enable the users to achieve good immersive experiences. The purpose of this paper is to illustrate a method to obtain a mesh with high quality texture combining a raw 3D mesh model of the environment and 360° images. The main outcome is a mesh with a high level of photorealistic details. This enables both a good depth perception thanks to the mesh model and high visualization quality thanks to the 2D resolution of modern omnidirectional cameras. The fundamental step to reach this goal is the correct alignment between the 360° camera and the 3D mesh model. For this reason, we propose a method that embodies two steps: 1) find the 360° cameras pose within the current 3D environment; 2) project the high-quality 360° image on top of the mesh. After the method description, we outline its validation in two virtual reality scenarios, a mine and city environment, respectively, which allows us to compare the achieved results with the ground truth.
KW - camera pose estimation
KW - enhanced comprehension
KW - mesh reconstruction
KW - Omnidirectional cameras
KW - optimization
UR - http://www.scopus.com/inward/record.url?scp=85131559723&partnerID=8YFLogxK
U2 - 10.21014/acta_imeko.v11i2.1127
DO - 10.21014/acta_imeko.v11i2.1127
M3 - Article
AN - SCOPUS:85131559723
VL - 11
JO - Acta IMEKO
JF - Acta IMEKO
SN - 0237-028X
IS - 2
ER -