Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration

Lucas Paletta, Amir Dini, Cornelia Murko, Saeed Yahyanejad, Ursula Augsdörfer

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Human attention processes play a major role in the optimization of human-robot collaboration (HRC) [Huang et al. 2015]. We describe a novel methodology to measure and predict situation awareness from eye and head gaze features in real-time. The awareness about scene objects of interest was described by 3D gaze analysis using data from eye tracking glasses and a precise optical tracking system. A probabilistic framework of uncertainty considers coping with measurement errors in eye and position estimation. Comprehensive experiments on HRC were conducted with typical tasks including handover in a lab based prototypical manufacturing environment. The gaze features highly correlate with scores of standardized questionnaires of situation awareness (SART [Taylor 1990], SAGAT [Endsley 2000]) and predict performance in the HRC task. This will open new opportunities for human factors based optimization in HRC applications.
Original languageEnglish
Title of host publicationProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications
Place of PublicationNew York
Pages1-3
Volume61
Publication statusPublished - 25 Jun 2019

Fingerprint

Robots
Robot applications
Human engineering
Measurement errors
Glass
Experiments
Uncertainty

Keywords

  • dual task
  • human-robot collaboration
  • situation awareness

Cite this

Paletta, L., Dini, A., Murko, C., Yahyanejad, S., & Augsdörfer, U. (2019). Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (Vol. 61, pp. 1-3). New York.

Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration. / Paletta, Lucas; Dini, Amir; Murko, Cornelia ; Yahyanejad, Saeed ; Augsdörfer, Ursula.

Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. Vol. 61 New York, 2019. p. 1-3.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Paletta, L, Dini, A, Murko, C, Yahyanejad, S & Augsdörfer, U 2019, Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration. in Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. vol. 61, New York, pp. 1-3.
Paletta L, Dini A, Murko C, Yahyanejad S, Augsdörfer U. Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. Vol. 61. New York. 2019. p. 1-3
Paletta, Lucas ; Dini, Amir ; Murko, Cornelia ; Yahyanejad, Saeed ; Augsdörfer, Ursula. / Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. Vol. 61 New York, 2019. pp. 1-3
@inproceedings{d44d60ba11784ef6b2bbfacfd1e6e1bc,
title = "Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration",
abstract = "Human attention processes play a major role in the optimization of human-robot collaboration (HRC) [Huang et al. 2015]. We describe a novel methodology to measure and predict situation awareness from eye and head gaze features in real-time. The awareness about scene objects of interest was described by 3D gaze analysis using data from eye tracking glasses and a precise optical tracking system. A probabilistic framework of uncertainty considers coping with measurement errors in eye and position estimation. Comprehensive experiments on HRC were conducted with typical tasks including handover in a lab based prototypical manufacturing environment. The gaze features highly correlate with scores of standardized questionnaires of situation awareness (SART [Taylor 1990], SAGAT [Endsley 2000]) and predict performance in the HRC task. This will open new opportunities for human factors based optimization in HRC applications.",
keywords = "dual task, human-robot collaboration, situation awareness",
author = "Lucas Paletta and Amir Dini and Cornelia Murko and Saeed Yahyanejad and Ursula Augsd{\"o}rfer",
year = "2019",
month = "6",
day = "25",
language = "English",
volume = "61",
pages = "1--3",
booktitle = "Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications",

}

TY - GEN

T1 - Estimation of situation awareness score and performance using eye and head gaze for human-robot collaboration

AU - Paletta, Lucas

AU - Dini, Amir

AU - Murko, Cornelia

AU - Yahyanejad, Saeed

AU - Augsdörfer, Ursula

PY - 2019/6/25

Y1 - 2019/6/25

N2 - Human attention processes play a major role in the optimization of human-robot collaboration (HRC) [Huang et al. 2015]. We describe a novel methodology to measure and predict situation awareness from eye and head gaze features in real-time. The awareness about scene objects of interest was described by 3D gaze analysis using data from eye tracking glasses and a precise optical tracking system. A probabilistic framework of uncertainty considers coping with measurement errors in eye and position estimation. Comprehensive experiments on HRC were conducted with typical tasks including handover in a lab based prototypical manufacturing environment. The gaze features highly correlate with scores of standardized questionnaires of situation awareness (SART [Taylor 1990], SAGAT [Endsley 2000]) and predict performance in the HRC task. This will open new opportunities for human factors based optimization in HRC applications.

AB - Human attention processes play a major role in the optimization of human-robot collaboration (HRC) [Huang et al. 2015]. We describe a novel methodology to measure and predict situation awareness from eye and head gaze features in real-time. The awareness about scene objects of interest was described by 3D gaze analysis using data from eye tracking glasses and a precise optical tracking system. A probabilistic framework of uncertainty considers coping with measurement errors in eye and position estimation. Comprehensive experiments on HRC were conducted with typical tasks including handover in a lab based prototypical manufacturing environment. The gaze features highly correlate with scores of standardized questionnaires of situation awareness (SART [Taylor 1990], SAGAT [Endsley 2000]) and predict performance in the HRC task. This will open new opportunities for human factors based optimization in HRC applications.

KW - dual task

KW - human-robot collaboration

KW - situation awareness

M3 - Conference contribution

VL - 61

SP - 1

EP - 3

BT - Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

CY - New York

ER -