Video See-Through Mixed Reality with Focus Cues

Research output: Contribution to journalArticlepeer-review


This work introduces the first approach to video see-through mixed reality with full support for focus cues. By combining the flexibility to adjust the focus distance found in varifocal designs with the robustness to eye-tracking error found in multifocal designs, our novel display architecture reliably delivers focus cues over a large workspace. In particular, we introduce gaze-contingent layered displays and mixed reality focal stacks, an efficient representation of mixed reality content that lends itself to fast processing for driving layered displays in real time. We thoroughly evaluate this approach by building a complete end-to-end pipeline for capture, render, and display of focus cues in video see-through displays that uses only off-the-shelf hardware and compute components.

Original languageEnglish
Pages (from-to)2256-2266
Number of pages11
JournalIEEE Transactions on Visualization and Computer Graphics
Issue number5
Publication statusPublished - 1 May 2022


  • Focus cues
  • Mixed reality
  • Video see-through

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Video See-Through Mixed Reality with Focus Cues'. Together they form a unique fingerprint.

Cite this