A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs

Christian Breitwieser, Christoph Pokorny, Gernot R. Müller-Putz

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Objective. This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain-computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. Approach. Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. Main results. A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. Significance. It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.

Original languageEnglish
Article number066015
JournalJournal of neural engineering
Volume13
Issue number6
DOIs
Publication statusPublished - 27 Oct 2016

Fingerprint

Brain-Computer Interfaces
Brain computer interface
Somatosensory Evoked Potentials
Enterprise resource planning
Bioelectric potentials
Computer Systems
Evoked Potentials
Hybrid Computers
Classifiers
Fusion reactions
Touch
Screening
Cues
Electroencephalography
Analysis of Variance
Hand
Analysis of variance (ANOVA)

Keywords

  • BCI
  • brain-computer interface
  • hybrid
  • P300
  • SSSEP
  • steady-state somatosensory evoked potential
  • tERP

ASJC Scopus subject areas

  • Biomedical Engineering
  • Cellular and Molecular Neuroscience

Fields of Expertise

  • Human- & Biotechnology

Cite this

A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs. / Breitwieser, Christian; Pokorny, Christoph; Müller-Putz, Gernot R.

In: Journal of neural engineering, Vol. 13, No. 6, 066015, 27.10.2016.

Research output: Contribution to journalArticleResearchpeer-review

@article{007fc8908aff4ed686a70fd001e6f335,
title = "A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs",
abstract = "Objective. This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain-computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. Approach. Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. Main results. A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. Significance. It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.",
keywords = "BCI, brain-computer interface, hybrid, P300, SSSEP, steady-state somatosensory evoked potential, tERP",
author = "Christian Breitwieser and Christoph Pokorny and M{\"u}ller-Putz, {Gernot R.}",
year = "2016",
month = "10",
day = "27",
doi = "10.1088/1741-2560/13/6/066015",
language = "English",
volume = "13",
journal = "Journal of neural engineering",
issn = "1741-2560",
publisher = "IOP Publishing Ltd.",
number = "6",

}

TY - JOUR

T1 - A hybrid three-class brain-computer interface system utilizing SSSEPs and transient ERPs

AU - Breitwieser, Christian

AU - Pokorny, Christoph

AU - Müller-Putz, Gernot R.

PY - 2016/10/27

Y1 - 2016/10/27

N2 - Objective. This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain-computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. Approach. Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. Main results. A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. Significance. It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.

AB - Objective. This paper investigates the fusion of steady-state somatosensory evoked potentials (SSSEPs) and transient event-related potentials (tERPs), evoked through tactile simulation on the left and right-hand fingertips, in a three-class EEG based hybrid brain-computer interface. It was hypothesized, that fusing the input signals leads to higher classification rates than classifying tERP and SSSEP individually. Approach. Fourteen subjects participated in the studies, consisting of a screening paradigm to determine person dependent resonance-like frequencies and a subsequent online paradigm. The whole setup of the BCI system was based on open interfaces, following suggestions for a common implementation platform. During the online experiment, subjects were instructed to focus their attention on the stimulated fingertips as indicated by a visual cue. The recorded data were classified during runtime using a multi-class shrinkage LDA classifier and the outputs were fused together applying a posterior probability based fusion. Data were further analyzed offline, involving a combined classification of SSSEP and tERP features as a second fusion principle. The final results were tested for statistical significance applying a repeated measures ANOVA. Main results. A significant classification increase was achieved when fusing the results with a combined classification compared to performing an individual classification. Furthermore, the SSSEP classifier was significantly better in detecting a non-control state, whereas the tERP classifier was significantly better in detecting control states. Subjects who had a higher relative band power increase during the screening session also achieved significantly higher classification results than subjects with lower relative band power increase. Significance. It could be shown that utilizing SSSEP and tERP for hBCIs increases the classification accuracy and also that tERP and SSSEP are not classifying control- and non-control states with the same level of accuracy.

KW - BCI

KW - brain-computer interface

KW - hybrid

KW - P300

KW - SSSEP

KW - steady-state somatosensory evoked potential

KW - tERP

UR - http://www.scopus.com/inward/record.url?scp=85002142090&partnerID=8YFLogxK

U2 - 10.1088/1741-2560/13/6/066015

DO - 10.1088/1741-2560/13/6/066015

M3 - Article

VL - 13

JO - Journal of neural engineering

JF - Journal of neural engineering

SN - 1741-2560

IS - 6

M1 - 066015

ER -