Nature at Your Service-Nature Inspired Representations Combined with Eye-gaze Features to Infer User Attention and Provide Contextualized Support

Carla Souta Barreiros*, N. Silva, Viktoria Pammer-Schindler, Eduardo Enrique Veas

*Korrespondierende/r Autor/-in für diese Arbeit

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandBegutachtung


Internet of Things (IoT) enables the creation of sensing and computing machines to enhance the level of continuous adaptation and support provided by intelligent systems to humans. Nevertheless, these systems still depend on human intervention, for example, in maintenance and (re)configuration tasks. To this measure, the development of an Adaptive Instructional System (AIS) in the context of IoT allows for the creation of new, improved learning and training environments. One can test new approaches to improve the training and perception efficiency of humans. Examples are the use of virtual and augmented reality, the inclusion of nature inspired metaphors based on biophilic design and calm computing principles and the design of technology that aims at changing the users’ behaviour through persuasion and social influence. In this work, we specifically propose a nature inspired visual representation concept, BioIoT, to communicate sensor information. Our results show that this new representation contributes to the users’ well-being and performance while remaining as easy to understand as traditional data representations (based on an experiment with twelve participants over two weeks). We present a use case under which we apply the BioIoT concept. It serves the purpose of demonstrating the BioIoT benefits in a AR setting, when applied in households and workplaces scenarios. Furthermore, by leveraging our previous experience in the development of adaptive and supportive systems based on eye-tracking, we discuss the application of this new sensing technology to the support of users in machine intervention by using the user attention, i.e., eye-gaze, on different machine parts as a way to infer the user’s needs and adapt the system accordingly. In this way, a new level of continuous support can be provided to the users depending on their skill level and individual needs in the form of contextualized instructions and action recommendations based on user attention.
TitelAdaptive Instructional Systems - 2nd International Conference, AIS 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
Redakteure/-innenRobert A. Sottilare, Jessica Schwarz
Herausgeber (Verlag)Springer
ISBN (Print)9783030507879
PublikationsstatusElektronische Veröffentlichung vor Drucklegung. - 10 Juli 2020
Veranstaltung2nd International Conference on Adaptive Instructional Systems: AIS 2020 - Virtuell, Dänemark
Dauer: 19 Juli 202024 Juli 2020


NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band12214 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349


Konferenz2nd International Conference on Adaptive Instructional Systems

ASJC Scopus subject areas

  • Theoretische Informatik
  • Informatik (insg.)


Untersuchen Sie die Forschungsthemen von „Nature at Your Service-Nature Inspired Representations Combined with Eye-gaze Features to Infer User Attention and Provide Contextualized Support“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren