Real Time Detection and Tracking for Augmented Reality on Mobile Phones

Daniel Wagner, Gerhard Reitmayr, Alessandro Mulloni, Tom Drummond, Dieter Schmalstieg

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper, we present three techniques for 6DOF natural feature tracking in real time on mobile phones. We achieve interactive frame rates of up to 30 Hz for natural feature tracking from textured planar targets on current generation phones. We use an approach based on heavily modified state-of-the-art feature descriptors, namely SIFT and Ferns plus a template-matching-based tracker. While SIFT is known to be a strong, but computationally expensive feature descriptor, Ferns classification is fast, but requires large amounts of memory. This renders both original designs unsuitable for mobile phones. We give detailed descriptions on how we modified both approaches to make them suitable for mobile phones. The template-based tracker further increases the performance and robustness of the SIFT- and Ferns-based approaches. We present evaluations on robustness and performance and discuss their appropriateness for Augmented Reality applications.
Original languageEnglish
Pages (from-to)355-368
JournalIEEE Transactions on Visualization and Computer Graphics
Volume16
Issue number3
DOIs
Publication statusPublished - 2010

Fingerprint

Dive into the research topics of 'Real Time Detection and Tracking for Augmented Reality on Mobile Phones'. Together they form a unique fingerprint.

Cite this