Detecting system errors in virtual reality using EEG through error-related potentials

Hakim Si-Mohammed, Catarina Lopes-Dias, Maria Duarte, Ferran Argelaguet, Camille Jeunet, Géry Casiez, Gernot Müller-Putz, Anatole Lécuyer, Reinhold Scherer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

When persons interact with the environment and experience or witness an error (e.g. an unexpected event), a specific brain pattern, known as error-related potential (ErrP) can be observed in the electroencephalographic signals (EEG). Virtual Reality (VR) technology enables users to interact with computer-generated simulated environments and to provide multi-modal sensory feedback. Using VR systems can, however, be error-prone. In this paper, we investigate the presence of ErrPs when Virtual Reality users face 3 types of visualization errors: (Te) tracking errors when manipulating virtual objects, (Fe) feedback errors, and (Be) background anomalies. We conducted an experiment in which 15 participants were exposed to the 3 types of errors while performing a center-out pick and place task in virtual reality. The results showed that tracking errors generate error-related potentials, the other types of errors did not generate such discernible patterns. In addition, we show that it is possible to detect the ErrPs generated by tracking losses in single trial, with an accuracy of 85%. This constitutes a first step towards the automatic detection of error-related potentials in VR applications, paving the way to the design of adaptive and self-corrective VR/AR applications by exploiting information directly from the user’s brain.
Original languageEnglish
Title of host publicationProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2020
PublisherInstitute of Electrical and Electronics Engineers
Pages653-661
Number of pages9
ISBN (Electronic)978-1-7281-5608-8
DOIs
Publication statusPublished - Mar 2020
EventIEEE Virtual Reality 2020: IEEE VR 2020 - Virtual, Atlanta, United States
Duration: 22 Mar 202026 Mar 2020
http://ieeevr.org/2020/

Publication series

NameProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2020

Conference

ConferenceIEEE Virtual Reality 2020
Abbreviated title(VRW 2020
CountryUnited States
CityVirtual, Atlanta
Period22/03/2026/03/20
Other2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES WORKSHOPS
Internet address

Keywords

  • Human-centered computing
  • Treemaps
  • Visualization
  • Visualization design and evaluation methods
  • Visualization techniques

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Science Applications
  • Media Technology
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Detecting system errors in virtual reality using EEG through error-related potentials'. Together they form a unique fingerprint.

Cite this