Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.
Original languageEnglish
JournalIEEE transactions on visualization and computer graphics
DOIs
Publication statusE-pub ahead of print - 17 Jan 2018

Fingerprint

Drones
Space flight
User interfaces
Display devices
X rays
Experiments

Keywords

  • UAV imagery
  • Augmented Reality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fields of Expertise

  • Information, Communication & Computing

Treatment code (Nähere Zuordnung)

  • Application

Cite this

Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas. / Erat, Okan; Isop, Werner Alexander; Kalkofen, Denis; Schmalstieg, Dieter.

In: IEEE transactions on visualization and computer graphics, 17.01.2018.

Research output: Contribution to journalArticleResearchpeer-review

@article{7635fa2d37fa4587a9487f2948e9a706,
title = "Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas",
abstract = "Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.",
keywords = "UAV imagery, Augmented Reality",
author = "Okan Erat and Isop, {Werner Alexander} and Denis Kalkofen and Dieter Schmalstieg",
year = "2018",
month = "1",
day = "17",
doi = "10.1109/TVCG.2018.2794058",
language = "English",
journal = "IEEE transactions on visualization and computer graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",

}

TY - JOUR

T1 - Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas

AU - Erat, Okan

AU - Isop, Werner Alexander

AU - Kalkofen, Denis

AU - Schmalstieg, Dieter

PY - 2018/1/17

Y1 - 2018/1/17

N2 - Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.

AB - Drones allow exploring dangerous or impassable areas safely from a distant point of view. However, flight control from an egocentric view in narrow or constrained environments can be challenging. Arguably, an exocentric view would afford a better overview and, thus, more intuitive flight control of the drone. Unfortunately, such an exocentric view is unavailable when exploring indoor environments. This paper investigates the potential of drone-augmented human vision, i.e., of exploring the environment and controlling the drone indirectly from an exocentric viewpoint. If used with a see-through display, this approach can simulate X-ray vision to provide a natural view into an otherwise occluded environment. The user's view is synthesized from a three-dimensional reconstruction of the indoor environment using image-based rendering. This user interface is designed to reduce the cognitive load of the drone's flight control. The user can concentrate on the exploration of the inaccessible space, while flight control is largely delegated to the drone's autopilot system. We assess our system with a first experiment showing how drone-augmented human vision supports spatial understanding and improves natural interaction with the drone.

KW - UAV imagery

KW - Augmented Reality

U2 - 10.1109/TVCG.2018.2794058

DO - 10.1109/TVCG.2018.2794058

M3 - Article

JO - IEEE transactions on visualization and computer graphics

JF - IEEE transactions on visualization and computer graphics

SN - 1077-2626

ER -