BARTON: Low Power Tongue Movement Sensing with In-ear Barometers

Balz Maag, Zimu Zhou, Olga Saukh, Lothar Thiele

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Sensing tongue movements enables various applications in hands-free interaction and alternative communication. We propose BARTON, a BARometer based low-power and robust TONgue movement sensing system. Using a low sampling rate of below 50 Hz, and only extracting simple temporal features from in-ear pressure signals, we demonstrate that it is plausible to distinguish important tongue gestures (left, right, forward) at low power consumption. We prototype BARTON with commodity earpieces integrated with COTS barometers for in-ear pressure sensing and an ARM micro-controller for signal processing. Evaluations show that BARTON yields 94% classification accuracy and 8.4mW power consumption, which achieves comparable accuracy, but consumes 44 times lower energy than the state-of-the-art microphone-based solutions. BARTON is also robust to head movements and operates with music played directly from earphones.
LanguageEnglish
Title of host publicationProceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems
Subtitle of host publicationICPADS 2017
Place of PublicationLos Alamitos, CA
PublisherIEEE Computer Soc.
Pages9-16
Number of pages8
ISBN (Electronic)978-1-5386-2129-5
DOIs
StatusPublished - 2018
Event23rd IEEE International Conference on Parallel and Distributed Systems (ICPADS) - Shenzen, China
Duration: 15 Dec 201717 Dec 2017
http://futurenet.szu.edu.cn/icpads2017/?index.html

Conference

Conference23rd IEEE International Conference on Parallel and Distributed Systems (ICPADS)
CountryChina
CityShenzen
Period15/12/1717/12/17
Internet address

Fingerprint

Barometers
Electric power utilization
Earphones
Microphones
Signal processing
Sampling
Controllers
Communication

Keywords

  • Human computer interaction
  • Ubiquitous computing
  • Pressure sensors

Cite this

Maag, B., Zhou, Z., Saukh, O., & Thiele, L. (2018). BARTON: Low Power Tongue Movement Sensing with In-ear Barometers. In Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems: ICPADS 2017 (pp. 9-16). Los Alamitos, CA: IEEE Computer Soc.. DOI: 10.1109/ICPADS.2017.00013

BARTON: Low Power Tongue Movement Sensing with In-ear Barometers. / Maag, Balz; Zhou, Zimu; Saukh, Olga; Thiele, Lothar.

Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems: ICPADS 2017. Los Alamitos, CA : IEEE Computer Soc., 2018. p. 9-16.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Maag, B, Zhou, Z, Saukh, O & Thiele, L 2018, BARTON: Low Power Tongue Movement Sensing with In-ear Barometers. in Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems: ICPADS 2017. IEEE Computer Soc., Los Alamitos, CA, pp. 9-16, 23rd IEEE International Conference on Parallel and Distributed Systems (ICPADS), Shenzen, China, 15/12/17. DOI: 10.1109/ICPADS.2017.00013
Maag B, Zhou Z, Saukh O, Thiele L. BARTON: Low Power Tongue Movement Sensing with In-ear Barometers. In Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems: ICPADS 2017. Los Alamitos, CA: IEEE Computer Soc.2018. p. 9-16. Available from, DOI: 10.1109/ICPADS.2017.00013
Maag, Balz ; Zhou, Zimu ; Saukh, Olga ; Thiele, Lothar. / BARTON: Low Power Tongue Movement Sensing with In-ear Barometers. Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems: ICPADS 2017. Los Alamitos, CA : IEEE Computer Soc., 2018. pp. 9-16
@inproceedings{3aab1b91b902472da4cf2fe36ca8fc2e,
title = "BARTON: Low Power Tongue Movement Sensing with In-ear Barometers",
abstract = "Sensing tongue movements enables various applications in hands-free interaction and alternative communication. We propose BARTON, a BARometer based low-power and robust TONgue movement sensing system. Using a low sampling rate of below 50 Hz, and only extracting simple temporal features from in-ear pressure signals, we demonstrate that it is plausible to distinguish important tongue gestures (left, right, forward) at low power consumption. We prototype BARTON with commodity earpieces integrated with COTS barometers for in-ear pressure sensing and an ARM micro-controller for signal processing. Evaluations show that BARTON yields 94{\%} classification accuracy and 8.4mW power consumption, which achieves comparable accuracy, but consumes 44 times lower energy than the state-of-the-art microphone-based solutions. BARTON is also robust to head movements and operates with music played directly from earphones.",
keywords = "Human computer interaction, Ubiquitous computing, Pressure sensors",
author = "Balz Maag and Zimu Zhou and Olga Saukh and Lothar Thiele",
year = "2018",
doi = "10.1109/ICPADS.2017.00013",
language = "English",
pages = "9--16",
booktitle = "Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems",
publisher = "IEEE Computer Soc.",

}

TY - GEN

T1 - BARTON: Low Power Tongue Movement Sensing with In-ear Barometers

AU - Maag,Balz

AU - Zhou,Zimu

AU - Saukh,Olga

AU - Thiele,Lothar

PY - 2018

Y1 - 2018

N2 - Sensing tongue movements enables various applications in hands-free interaction and alternative communication. We propose BARTON, a BARometer based low-power and robust TONgue movement sensing system. Using a low sampling rate of below 50 Hz, and only extracting simple temporal features from in-ear pressure signals, we demonstrate that it is plausible to distinguish important tongue gestures (left, right, forward) at low power consumption. We prototype BARTON with commodity earpieces integrated with COTS barometers for in-ear pressure sensing and an ARM micro-controller for signal processing. Evaluations show that BARTON yields 94% classification accuracy and 8.4mW power consumption, which achieves comparable accuracy, but consumes 44 times lower energy than the state-of-the-art microphone-based solutions. BARTON is also robust to head movements and operates with music played directly from earphones.

AB - Sensing tongue movements enables various applications in hands-free interaction and alternative communication. We propose BARTON, a BARometer based low-power and robust TONgue movement sensing system. Using a low sampling rate of below 50 Hz, and only extracting simple temporal features from in-ear pressure signals, we demonstrate that it is plausible to distinguish important tongue gestures (left, right, forward) at low power consumption. We prototype BARTON with commodity earpieces integrated with COTS barometers for in-ear pressure sensing and an ARM micro-controller for signal processing. Evaluations show that BARTON yields 94% classification accuracy and 8.4mW power consumption, which achieves comparable accuracy, but consumes 44 times lower energy than the state-of-the-art microphone-based solutions. BARTON is also robust to head movements and operates with music played directly from earphones.

KW - Human computer interaction

KW - Ubiquitous computing

KW - Pressure sensors

U2 - 10.1109/ICPADS.2017.00013

DO - 10.1109/ICPADS.2017.00013

M3 - Conference contribution

SP - 9

EP - 16

BT - Proceedings 2017 IEEE 23rd International Conference on Parallel and Distributed Systems

PB - IEEE Computer Soc.

CY - Los Alamitos, CA

ER -