Projects per year
Abstract
Diminished Reality (DR) propagates pixels from a keyframe to subsequent frames for real-time inpainting. Keyframe selection has a significant impact on the inpainting quality, but untrained users struggle to identify good keyframes. Automatic selection is not straightforward either, since no previous work has formalized or verified what determines a good keyframe. We propose a novel metric to select good keyframes to inpaint. We examine the heuristics adopted in existing DR inpainting approaches and derive multiple simple criteria measurable from SLAM. To combine these criteria, we empirically analyze their effect on the quality using a novel representative test dataset. Our results demonstrate that the combined metric selects RGBD keyframes leading to high-quality inpainting results more often than a baseline approach in both color and depth domains. Also, we confirmed that our approach has a better ranking ability of distinguishing good and bad keyframes. Compared to random selections, our metric selects keyframes that would lead to higher-quality and more stably converging inpainting results. We present three DR examples, automatic keyframe selection, user navigation, and marker hiding.
Original language | English |
---|---|
Pages (from-to) | 1 |
Number of pages | 1 |
Journal | IEEE Transactions on Visualization and Computer Graphics |
DOIs | |
Publication status | Published - 23 May 2022 |
Keywords
- Augmented Reality
- Diminished Reality
- Inpainting
- Measurement
- SLAM
- Diminished reality
- Image reconstruction
- keyframe
- inpainting
- Simultaneous localization and mapping
- Three-dimensional displays
- Streaming media
- Cameras
- good keyframes to inpaint
- Real-time systems
ASJC Scopus subject areas
- Software
- Signal Processing
- Computer Vision and Pattern Recognition
- Computer Graphics and Computer-Aided Design
Fingerprint
Dive into the research topics of 'Good Keyframes to Inpaint'. Together they form a unique fingerprint.Projects
- 1 Active
-
FWF - 3DDR - Real-time Three-Dimensional Diminished Reality
1/01/21 → 31/12/24
Project: Research project
Activities
-
Good Keyframes to Inpaint
Shohei Mori (Speaker)
18 Oct 2022Activity: Talk or presentation › Talk at conference or symposium › Science to science
-
2022 IEEE International Symposium on Mixed and Augmented Reality
Shohei Mori (Participant)
17 Oct 2022 → 21 Oct 2022Activity: Participation in or organisation of › Conference or symposium (Participation in/Organisation of)
-
How Far Can We Go for Diminished Reality Without Neural Networks?
Shohei Mori (Speaker)
21 Oct 2022Activity: Talk or presentation › Invited talk at conference or symposium › Science to science