TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays

Peter Mohr-Ziak, Markus Tatzgern, Tobias Langlotz, Andreas Lang, Dieter Schmalstieg, Denis Kalkofen

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD's field of view, while it provides additional 2D input and output capabilities.
Original languageEnglish
Title of host publicationProceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Number of pages585
Publication statusPublished - 2019

Fingerprint

Smartphones
Display devices
Helmet mounted displays
Sensors

Cite this

Mohr-Ziak, P., Tatzgern, M., Langlotz, T., Lang, A., Schmalstieg, D., & Kalkofen, D. (2019). TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. / Mohr-Ziak, Peter; Tatzgern, Markus; Langlotz, Tobias; Lang, Andreas; Schmalstieg, Dieter; Kalkofen, Denis.

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Mohr-Ziak, P, Tatzgern, M, Langlotz, T, Lang, A, Schmalstieg, D & Kalkofen, D 2019, TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.
Mohr-Ziak P, Tatzgern M, Langlotz T, Lang A, Schmalstieg D, Kalkofen D. TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019
Mohr-Ziak, Peter ; Tatzgern, Markus ; Langlotz, Tobias ; Lang, Andreas ; Schmalstieg, Dieter ; Kalkofen, Denis. / TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 2019.
@inproceedings{639f78bcf6454eed9e2d640c8f91f9d9,
title = "TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays",
abstract = "The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD's field of view, while it provides additional 2D input and output capabilities.",
author = "Peter Mohr-Ziak and Markus Tatzgern and Tobias Langlotz and Andreas Lang and Dieter Schmalstieg and Denis Kalkofen",
year = "2019",
language = "English",
booktitle = "Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems",

}

TY - GEN

T1 - TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays

AU - Mohr-Ziak, Peter

AU - Tatzgern, Markus

AU - Langlotz, Tobias

AU - Lang, Andreas

AU - Schmalstieg, Dieter

AU - Kalkofen, Denis

PY - 2019

Y1 - 2019

N2 - The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD's field of view, while it provides additional 2D input and output capabilities.

AB - The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD's field of view, while it provides additional 2D input and output capabilities.

M3 - Conference contribution

BT - Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

ER -