Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas

Okan Erat, Werner Alexander Isop, Denis Kalkofen, Dieter Schmalstieg

Research output: Contribution to journalArticle


Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.
Original languageEnglish
JournalIEEE Transactions on Visualization and Computer Graphics
Publication statusE-pub ahead of print - 17 Jan 2018


  • UAV imagery
  • Augmented Reality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fields of Expertise

  • Information, Communication & Computing

Treatment code (Nähere Zuordnung)

  • Application

Fingerprint Dive into the research topics of 'Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas'. Together they form a unique fingerprint.

Cite this