Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography

Caterina Nahler, Bernhard Feldhofer, Matthias Ruether, Gerald Holweg, Norbert Druml

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

Original languageEnglish
Title of host publicationProceedings - 21st Euromicro Conference on Digital System Design, DSD 2018
PublisherInstitute of Electrical and Electronics Engineers
Pages433-441
Number of pages9
ISBN (Electronic)9781538673768
DOIs
Publication statusPublished - 12 Oct 2018
Event21st Euromicro Conference on Digital System Design, DSD 2018 - Prague, Czech Republic
Duration: 29 Aug 201831 Aug 2018

Conference

Conference21st Euromicro Conference on Digital System Design, DSD 2018
Abbreviated titleDSD 2018
CountryCzech Republic
CityPrague
Period29/08/1831/08/18

Fingerprint

Photoplethysmography
Cameras
Electrocardiography
Skin
Infrared radiation
Polarization mode dispersion
Blind source separation
Correlation methods
Sensors
Light sources
Lighting
Pixels
Monitoring

Keywords

  • Contact
  • Heart beat
  • Infrared
  • Photoplethysmography
  • PPG
  • Pulse
  • Remote
  • RPPG
  • Time-of-Flight
  • ToF

ASJC Scopus subject areas

  • Hardware and Architecture

Cite this

Nahler, C., Feldhofer, B., Ruether, M., Holweg, G., & Druml, N. (2018). Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. In Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018 (pp. 433-441). [8491850] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/DSD.2018.00079

Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. / Nahler, Caterina; Feldhofer, Bernhard; Ruether, Matthias; Holweg, Gerald; Druml, Norbert.

Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers, 2018. p. 433-441 8491850.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Nahler, C, Feldhofer, B, Ruether, M, Holweg, G & Druml, N 2018, Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. in Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018., 8491850, Institute of Electrical and Electronics Engineers, pp. 433-441, 21st Euromicro Conference on Digital System Design, DSD 2018, Prague, Czech Republic, 29/08/18. https://doi.org/10.1109/DSD.2018.00079
Nahler C, Feldhofer B, Ruether M, Holweg G, Druml N. Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. In Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers. 2018. p. 433-441. 8491850 https://doi.org/10.1109/DSD.2018.00079
Nahler, Caterina ; Feldhofer, Bernhard ; Ruether, Matthias ; Holweg, Gerald ; Druml, Norbert. / Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers, 2018. pp. 433-441
@inproceedings{51ec65867d2e4016a2d386c2fd706961,
title = "Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography",
abstract = "The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.",
keywords = "Contact, Heart beat, Infrared, Photoplethysmography, PPG, Pulse, Remote, RPPG, Time-of-Flight, ToF",
author = "Caterina Nahler and Bernhard Feldhofer and Matthias Ruether and Gerald Holweg and Norbert Druml",
year = "2018",
month = "10",
day = "12",
doi = "10.1109/DSD.2018.00079",
language = "English",
pages = "433--441",
booktitle = "Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018",
publisher = "Institute of Electrical and Electronics Engineers",
address = "United States",

}

TY - GEN

T1 - Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography

AU - Nahler, Caterina

AU - Feldhofer, Bernhard

AU - Ruether, Matthias

AU - Holweg, Gerald

AU - Druml, Norbert

PY - 2018/10/12

Y1 - 2018/10/12

N2 - The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

AB - The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

KW - Contact

KW - Heart beat

KW - Infrared

KW - Photoplethysmography

KW - PPG

KW - Pulse

KW - Remote

KW - RPPG

KW - Time-of-Flight

KW - ToF

UR - http://www.scopus.com/inward/record.url?scp=85056469976&partnerID=8YFLogxK

U2 - 10.1109/DSD.2018.00079

DO - 10.1109/DSD.2018.00079

M3 - Conference contribution

SP - 433

EP - 441

BT - Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018

PB - Institute of Electrical and Electronics Engineers

ER -