Masked and unmasked error-related potentials during continuous control and feedback

Research output: Contribution to journalArticleResearchpeer-review

Abstract

The detection of error-related potentials (ErrPs) in tasks with discrete feedback is well established in the brain-computer interface (BCI) field. However, the decoding of ErrPs in tasks with continuous feedback is still in its early stages.
OBJECTIVE:

We developed a task in which subjects have continuous control of a cursor's position by means of a joystick. The cursor's position was shown to the participants in two different modalities of continuous feedback: normal and jittered. The jittered feedback was created to mimic the instability that could exist if participants controlled the trajectory directly with brain signals.
APPROACH:

This paper studies the electroencephalographic (EEG)-measurable signatures caused by a loss of control over the cursor's trajectory, causing a target miss.
MAIN RESULTS:

In both feedback modalities, time-locked potentials revealed the typical frontal-central components of error-related potentials. Errors occurring during the jittered feedback (masked errors) were delayed in comparison to errors occurring during normal feedback (unmasked errors). Masked errors displayed lower peak amplitudes than unmasked errors. Time-locked classification analysis allowed a good distinction between correct and error classes (average Cohen-[Formula: see text], average TPR  =  81.8% and average TNR  =  96.4%). Time-locked classification analysis between masked error and unmasked error classes revealed results at chance level (average Cohen-[Formula: see text], average TPR  =  60.9% and average TNR  =  58.3%). Afterwards, we performed asynchronous detection of ErrPs, combining both masked and unmasked trials. The asynchronous detection of ErrPs in a simulated online scenario resulted in an average TNR of 84.0% and in an average TPR of 64.9%.
SIGNIFICANCE:

The time-locked classification results suggest that the masked and unmasked errors were indistinguishable in terms of classification. The asynchronous classification results suggest that the feedback modality did not hinder the asynchronous detection of ErrPs
Original languageEnglish
JournalJournal of neural engineering
Volume15
Issue number3
DOIs
Publication statusPublished - 2018

Fingerprint

Feedback
Brain-Computer Interfaces
Trajectories
Brain computer interface
Brain
Decoding

Cite this

@article{83b0587fdd4f418ba1fb8cb69703d890,
title = "Masked and unmasked error-related potentials during continuous control and feedback",
abstract = "The detection of error-related potentials (ErrPs) in tasks with discrete feedback is well established in the brain-computer interface (BCI) field. However, the decoding of ErrPs in tasks with continuous feedback is still in its early stages.OBJECTIVE:We developed a task in which subjects have continuous control of a cursor's position by means of a joystick. The cursor's position was shown to the participants in two different modalities of continuous feedback: normal and jittered. The jittered feedback was created to mimic the instability that could exist if participants controlled the trajectory directly with brain signals.APPROACH:This paper studies the electroencephalographic (EEG)-measurable signatures caused by a loss of control over the cursor's trajectory, causing a target miss.MAIN RESULTS:In both feedback modalities, time-locked potentials revealed the typical frontal-central components of error-related potentials. Errors occurring during the jittered feedback (masked errors) were delayed in comparison to errors occurring during normal feedback (unmasked errors). Masked errors displayed lower peak amplitudes than unmasked errors. Time-locked classification analysis allowed a good distinction between correct and error classes (average Cohen-[Formula: see text], average TPR  =  81.8{\%} and average TNR  =  96.4{\%}). Time-locked classification analysis between masked error and unmasked error classes revealed results at chance level (average Cohen-[Formula: see text], average TPR  =  60.9{\%} and average TNR  =  58.3{\%}). Afterwards, we performed asynchronous detection of ErrPs, combining both masked and unmasked trials. The asynchronous detection of ErrPs in a simulated online scenario resulted in an average TNR of 84.0{\%} and in an average TPR of 64.9{\%}.SIGNIFICANCE:The time-locked classification results suggest that the masked and unmasked errors were indistinguishable in terms of classification. The asynchronous classification results suggest that the feedback modality did not hinder the asynchronous detection of ErrPs",
author = "{Lopes Dias}, {Maria Catarina} and Sburlea, {Andreea Ioana} and Gernot M{\"u}ller-Putz",
year = "2018",
doi = "10.1088/1741-2552/aab806",
language = "English",
volume = "15",
journal = "Journal of neural engineering",
issn = "1741-2560",
publisher = "IOP Publishing Ltd.",
number = "3",

}

TY - JOUR

T1 - Masked and unmasked error-related potentials during continuous control and feedback

AU - Lopes Dias, Maria Catarina

AU - Sburlea, Andreea Ioana

AU - Müller-Putz, Gernot

PY - 2018

Y1 - 2018

N2 - The detection of error-related potentials (ErrPs) in tasks with discrete feedback is well established in the brain-computer interface (BCI) field. However, the decoding of ErrPs in tasks with continuous feedback is still in its early stages.OBJECTIVE:We developed a task in which subjects have continuous control of a cursor's position by means of a joystick. The cursor's position was shown to the participants in two different modalities of continuous feedback: normal and jittered. The jittered feedback was created to mimic the instability that could exist if participants controlled the trajectory directly with brain signals.APPROACH:This paper studies the electroencephalographic (EEG)-measurable signatures caused by a loss of control over the cursor's trajectory, causing a target miss.MAIN RESULTS:In both feedback modalities, time-locked potentials revealed the typical frontal-central components of error-related potentials. Errors occurring during the jittered feedback (masked errors) were delayed in comparison to errors occurring during normal feedback (unmasked errors). Masked errors displayed lower peak amplitudes than unmasked errors. Time-locked classification analysis allowed a good distinction between correct and error classes (average Cohen-[Formula: see text], average TPR  =  81.8% and average TNR  =  96.4%). Time-locked classification analysis between masked error and unmasked error classes revealed results at chance level (average Cohen-[Formula: see text], average TPR  =  60.9% and average TNR  =  58.3%). Afterwards, we performed asynchronous detection of ErrPs, combining both masked and unmasked trials. The asynchronous detection of ErrPs in a simulated online scenario resulted in an average TNR of 84.0% and in an average TPR of 64.9%.SIGNIFICANCE:The time-locked classification results suggest that the masked and unmasked errors were indistinguishable in terms of classification. The asynchronous classification results suggest that the feedback modality did not hinder the asynchronous detection of ErrPs

AB - The detection of error-related potentials (ErrPs) in tasks with discrete feedback is well established in the brain-computer interface (BCI) field. However, the decoding of ErrPs in tasks with continuous feedback is still in its early stages.OBJECTIVE:We developed a task in which subjects have continuous control of a cursor's position by means of a joystick. The cursor's position was shown to the participants in two different modalities of continuous feedback: normal and jittered. The jittered feedback was created to mimic the instability that could exist if participants controlled the trajectory directly with brain signals.APPROACH:This paper studies the electroencephalographic (EEG)-measurable signatures caused by a loss of control over the cursor's trajectory, causing a target miss.MAIN RESULTS:In both feedback modalities, time-locked potentials revealed the typical frontal-central components of error-related potentials. Errors occurring during the jittered feedback (masked errors) were delayed in comparison to errors occurring during normal feedback (unmasked errors). Masked errors displayed lower peak amplitudes than unmasked errors. Time-locked classification analysis allowed a good distinction between correct and error classes (average Cohen-[Formula: see text], average TPR  =  81.8% and average TNR  =  96.4%). Time-locked classification analysis between masked error and unmasked error classes revealed results at chance level (average Cohen-[Formula: see text], average TPR  =  60.9% and average TNR  =  58.3%). Afterwards, we performed asynchronous detection of ErrPs, combining both masked and unmasked trials. The asynchronous detection of ErrPs in a simulated online scenario resulted in an average TNR of 84.0% and in an average TPR of 64.9%.SIGNIFICANCE:The time-locked classification results suggest that the masked and unmasked errors were indistinguishable in terms of classification. The asynchronous classification results suggest that the feedback modality did not hinder the asynchronous detection of ErrPs

U2 - 10.1088/1741-2552/aab806

DO - 10.1088/1741-2552/aab806

M3 - Article

VL - 15

JO - Journal of neural engineering

JF - Journal of neural engineering

SN - 1741-2560

IS - 3

ER -