TutAR: Augmented Reality Tutorials for Hands-only Procedures

Daniel Eckhoff; Christian Sandor; Christian Lins; Ulrich Eck; Andreas Hein; Denis Kalkofen

doi:10.1145/3284398.3284399

TutAR: Augmented Reality Tutorials for Hands-only Procedures

Daniel Eckhoff, Christian Sandor, Christian Lins, Ulrich Eck, Andreas Hein, Denis Kalkofen

Institute of Computer Graphics and Vision (7100)

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Abstract

With Augmented Reality (AR) on Optical See-Through Head-Mount-ed Displays (OST-HMD), users can observe the real world and com-puter graphics at the same time. In this work, we present the designand implementation of TutAR, a pipeline that semi-automaticallycreates AR tutorials of 2D RGB videos with hands-only proceduressuch as cardiopulmonary resuscitation (CPR). TutAR extracts rel-evant 3D hand motion from the input video. The derived handmotion will be displayed as an animated 3D hand relative to thehuman body and plays synchronously with the motion in the videoon an OST-HMD.

Original language	English
Title of host publication	Proceedings - VRCAI 2018
Subtitle of host publication	16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
DOIs	https://doi.org/10.1145/3284398.3284399
Publication status	Published - Dec 2018
Event	16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry: VRCAI 2018 - Tokyo, Japan Duration: 2 Dec 2018 → 3 Dec 2018

Conference

Conference	16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Country/Territory	Japan
City	Tokyo
Period	2/12/18 → 3/12/18

Access to Document

10.1145/3284398.3284399

Cite this

Eckhoff, D, Sandor, C, Lins, C, Eck, U, Hein, A & Kalkofen, D 2018, TutAR: Augmented Reality Tutorials for Hands-only Procedures. in Proceedings - VRCAI 2018: 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, Tokyo, Japan, 2/12/18. https://doi.org/10.1145/3284398.3284399

@inproceedings{589b2f496da44a71aa17108666c07b80,

title = "TutAR: Augmented Reality Tutorials for Hands-only Procedures",

abstract = "With Augmented Reality (AR) on Optical See-Through Head-Mount-ed Displays (OST-HMD), users can observe the real world and com-puter graphics at the same time. In this work, we present the designand implementation of TutAR, a pipeline that semi-automaticallycreates AR tutorials of 2D RGB videos with hands-only proceduressuch as cardiopulmonary resuscitation (CPR). TutAR extracts rel-evant 3D hand motion from the input video. The derived handmotion will be displayed as an animated 3D hand relative to thehuman body and plays synchronously with the motion in the videoon an OST-HMD.",

author = "Daniel Eckhoff and Christian Sandor and Christian Lins and Ulrich Eck and Andreas Hein and Denis Kalkofen",

year = "2018",

month = dec,

doi = "10.1145/3284398.3284399",

language = "English",

booktitle = "Proceedings - VRCAI 2018",

note = "16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry : VRCAI 2018 ; Conference date: 02-12-2018 Through 03-12-2018",

}

TY - GEN

T1 - TutAR: Augmented Reality Tutorials for Hands-only Procedures

AU - Eckhoff, Daniel

AU - Sandor, Christian

AU - Lins, Christian

AU - Eck, Ulrich

AU - Hein, Andreas

AU - Kalkofen, Denis

PY - 2018/12

Y1 - 2018/12

N2 - With Augmented Reality (AR) on Optical See-Through Head-Mount-ed Displays (OST-HMD), users can observe the real world and com-puter graphics at the same time. In this work, we present the designand implementation of TutAR, a pipeline that semi-automaticallycreates AR tutorials of 2D RGB videos with hands-only proceduressuch as cardiopulmonary resuscitation (CPR). TutAR extracts rel-evant 3D hand motion from the input video. The derived handmotion will be displayed as an animated 3D hand relative to thehuman body and plays synchronously with the motion in the videoon an OST-HMD.

AB - With Augmented Reality (AR) on Optical See-Through Head-Mount-ed Displays (OST-HMD), users can observe the real world and com-puter graphics at the same time. In this work, we present the designand implementation of TutAR, a pipeline that semi-automaticallycreates AR tutorials of 2D RGB videos with hands-only proceduressuch as cardiopulmonary resuscitation (CPR). TutAR extracts rel-evant 3D hand motion from the input video. The derived handmotion will be displayed as an animated 3D hand relative to thehuman body and plays synchronously with the motion in the videoon an OST-HMD.

U2 - 10.1145/3284398.3284399

DO - 10.1145/3284398.3284399

M3 - Conference paper

BT - Proceedings - VRCAI 2018

T2 - 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Y2 - 2 December 2018 through 3 December 2018

ER -

TutAR: Augmented Reality Tutorials for Hands-only Procedures

Abstract

Conference

Access to Document

Fingerprint

Cite this