Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography

Caterina Nahler, Bernhard Feldhofer, Matthias Ruether, Gerald Holweg, Norbert Druml

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

Originalspracheenglisch
TitelProceedings - 21st Euromicro Conference on Digital System Design, DSD 2018
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers
Seiten433-441
Seitenumfang9
ISBN (elektronisch)9781538673768
DOIs
PublikationsstatusVeröffentlicht - 12 Okt 2018
Veranstaltung21st Euromicro Conference on Digital System Design - Prague, Tschechische Republik
Dauer: 29 Aug 201831 Aug 2018

Konferenz

Konferenz21st Euromicro Conference on Digital System Design
KurztitelDSD 2018
LandTschechische Republik
OrtPrague
Zeitraum29/08/1831/08/18

Fingerprint

Photoplethysmography
Cameras
Electrocardiography
Skin
Infrared radiation
Polarization mode dispersion
Blind source separation
Correlation methods
Sensors
Light sources
Lighting
Pixels
Monitoring

Schlagwörter

    ASJC Scopus subject areas

    • !!Hardware and Architecture

    Dies zitieren

    Nahler, C., Feldhofer, B., Ruether, M., Holweg, G., & Druml, N. (2018). Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. in Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018 (S. 433-441). [8491850] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/DSD.2018.00079

    Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. / Nahler, Caterina; Feldhofer, Bernhard; Ruether, Matthias; Holweg, Gerald; Druml, Norbert.

    Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers, 2018. S. 433-441 8491850.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Nahler, C, Feldhofer, B, Ruether, M, Holweg, G & Druml, N 2018, Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. in Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018., 8491850, Institute of Electrical and Electronics Engineers, S. 433-441, 21st Euromicro Conference on Digital System Design, Prague, Tschechische Republik, 29/08/18. https://doi.org/10.1109/DSD.2018.00079
    Nahler C, Feldhofer B, Ruether M, Holweg G, Druml N. Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. in Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers. 2018. S. 433-441. 8491850 https://doi.org/10.1109/DSD.2018.00079
    Nahler, Caterina ; Feldhofer, Bernhard ; Ruether, Matthias ; Holweg, Gerald ; Druml, Norbert. / Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography. Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018. Institute of Electrical and Electronics Engineers, 2018. S. 433-441
    @inproceedings{51ec65867d2e4016a2d386c2fd706961,
    title = "Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography",
    abstract = "The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.",
    keywords = "Contact, Heart beat, Infrared, Photoplethysmography, PPG, Pulse, Remote, RPPG, Time-of-Flight, ToF",
    author = "Caterina Nahler and Bernhard Feldhofer and Matthias Ruether and Gerald Holweg and Norbert Druml",
    year = "2018",
    month = "10",
    day = "12",
    doi = "10.1109/DSD.2018.00079",
    language = "English",
    pages = "433--441",
    booktitle = "Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018",
    publisher = "Institute of Electrical and Electronics Engineers",
    address = "United States",

    }

    TY - GEN

    T1 - Exploring the usage of time-of-flight cameras for contact and remote photoplethysmography

    AU - Nahler, Caterina

    AU - Feldhofer, Bernhard

    AU - Ruether, Matthias

    AU - Holweg, Gerald

    AU - Druml, Norbert

    PY - 2018/10/12

    Y1 - 2018/10/12

    N2 - The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

    AB - The heart beat is one of the basic vital signs, but the pulse wave can communicate much more information than the beat frequency of the heart. Through the heart rate variability (HRV) among other things, stress level and drowsiness can be inferred. Reliable HRV measurements are commonly obtained by electrocardiography (ECG). In this paper we analyse the correlation between HRV and pulse rate variability (PRV) obtained from contact or remote photoplethysmography (PPG) on a Time-of-Flight (ToF) camera from PMD Technologies AG. The ToF camera is independent of passive illumination as it uses an infrared (IR) light source, which is invisible to the human eye. Therefore, potential use cases include driver monitoring or convenient heart rate measurement with smart phones. We will demonstrate methods for using a ToF camera for contact and remote PPG. For contact PPG the sensor is mounted directly on the subjects body. The pulse wave is calculated as the mean amplitude intensity of all pixels. For remote PPG the sensor is mounted to measure the subjects face. The pulse wave cannot be found in every part of exposed skin. Therefore, the part of the skin with the clearest signal is localised and the pulse wave is recovered from there, by means of passband filtering and blind source separation. Our results show that contact PPG on a ToF camera has high accuracy and highly correlates with a commercial IR pulse oximetry device, as well as with an ECG grade chest belt. For remote PPG our method shows correlation with the ToF contact PPG signal.

    KW - Contact

    KW - Heart beat

    KW - Infrared

    KW - Photoplethysmography

    KW - PPG

    KW - Pulse

    KW - Remote

    KW - RPPG

    KW - Time-of-Flight

    KW - ToF

    UR - http://www.scopus.com/inward/record.url?scp=85056469976&partnerID=8YFLogxK

    U2 - 10.1109/DSD.2018.00079

    DO - 10.1109/DSD.2018.00079

    M3 - Conference contribution

    SP - 433

    EP - 441

    BT - Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018

    PB - Institute of Electrical and Electronics Engineers

    ER -